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Chapter  1 

Introduction 


The  models  of  control  systems  encountered  in  several  diverse  naval  applications  are  nonlinear;  moreover,  they 
are  also  time-varying,  and  have  uncertainties  affecting  them.  The  underlying  controller  design  problems, 
beyond  requiring  system  stability,  also  typically  require  the  optimization  of  some  performance  objectives. 
Ideally,  the  control  law  should  have  the  properties  that:  (1)  it  adapts  itself  according  to  the  nonlinearities;  (2) 
it  can  handle  several  performance  objectives  (besides  stability)  in  a  uniform  manner;  and  (3)  it  guarantees 
the  performance  of  the  closed-loop  system  in  spite  of  the  variations  and  the  uncertainties. 

The  primary  goal  of  the  project  was  a  numerical  solution  methodology  for  solving  the  general  nonlin¬ 
ear  controller  design  problem.  Our  approach  is  motivated  by  recent  advances  in  control  and  optimization 
theory  as  well  as  the  sustained  growth  in  the  available  computing  power  over  the  past  few  years.  The 
proposed  controller  architecture  is  gain-scheduled  (i.e.,  the  controller  uses  the  measured  nonlinearities  and 
time- variations) ,  and  optimizes  the  worst-case  performance — over  the  uncertainties  of  the  system.  The 
search  for  the  optimal  controller  parameters  can  be  reformulated  as  convex  optimization  problems  involving 
linear  matrix  inequalities  (LMIs)  in  several  important  cases.  The  design  approach  lends  itself  naturally  to 
the  development  of  computer-aided  design  tools,  and  enjoys  the  advantages  of  widespread  applicability,  ease 
of  implementation  and  cost  effectiveness.  Another  goal  of  this  research  project  was  to  integrate  the  advances 
in  gain-scheduled  controller  design  with  the  project  Intelligent  Information  and  Autonomous  Agents 
Applied  Research  on  Unmanned  Combat  Air  Vehicles,  directed  by  Dr.  Allen  Moshfegh. 

A  third  goal  of  the  project  was  the  development  of  robust  estimation  techniques.  Estimation  problems  arise 
in  many  naval  applications  in  control,  communications  and  signal  processing  areas.  Traditional  estimation 
algorithms  are  usually  based  on  a  nominal  system  model  without  uncertainty.  However,  in  many  cases, 
there  exist  uncertainties  in  model  parameters  and  even  model  structures  because  of  modeling  errors  from 
system  identifications.  These  uncertainties  may  degrade  the  estimation  performance  of  the  algorithm  without 
robustness. 

In  this  report,  we  will  describe  the  results  from  the  pursuit  of  the  goals  listed  above. 


1.1  Analysis  and  gain-scheduled  control 

The  plant  model  consists  of  a  nominal  system,  which  is  affected  by  unmeasurable  uncertainties  Aunmeas- 
Measurable  uncertainties  such  as  parameter  variations  are  accounted  for  by  Ameas .  y  consists  of  sensor 
signals,  u  consists  of  actuator  inputs,  w  consists  of  exogenous  signals  (noises,  reference  inputs  etc),  and  z 
contains  all  the  signals  of  interest.  The  map  from  w  to  z  contains  all  input-output  maps  of  interest.  The 
objective  is  to  design  a  control  law  u  =  K(y)  so  that  the  closed-loop  system  map  from  w  to  z  possesses 
“desirable”  properties. 

The  controller  architecture  that  we  have  studied  is  one  where  the  controller  itself  is  in  a  feedback  con¬ 
figuration  with  a  linear  part,  with  the  measured  uncertainties  Ameas  appearing  in  a  feedback  loop.  The 
closed-loop  system  architecture  is  shown  in  Fig.  1.1,  with  the  controller  enclosed  in  dotted  lines.  Thus, 
depending  on  the  nature  of  Ameas,  the  controller  may  be  LTI,  linear  time-varying,  or  even  nonlinear. 

We  have  solved  a  number  of  robustness  analysis  and  design  problems  in  this  setting. 
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Figure  1.1:  Closed- loop  system.  The  gain-scheduled  controller  Kgs^s  shown  enclosed  in  dashed  lines. 

List  of  research  results 

L  Robust  performance  analysis  using  Lyapunov  functions. 

The  first  step  in  realizing  the  project  goals  is  that  of  robust  performance  analysis;  the  results  achieved 
with  this  goal  are  summarized  in  Chapter  2. 

2.  Robustness  under  bounded  uncertainty  with  phase  information. 

The  special  case  where  the  uncertainties,  in  addition  to  being  bounded,  also  satisfy  constraints  on  their 
phase,  is  of  particular  interest.  Robustness  analysis  of  such  systems  is  presented  in  Chapter  3. 

3.  Efficient  computation  of  a  guaranteed  lower  bound  on  the  robust  stability  margin  of  uncertain  systems. 

We  were  also  able  to  substantially  reduce  the  computational  burden  associated  with  LMI  methods  for 
establishing  robust  stability.  In  Chapter  4,  we  describe  efficient  computational  methods  for  determining 
a  guaranteed  lower  bound  on  the  robust  stability  margin  of  uncertain  systems. 

4.  Improved  stability  analysis  and  gain-scheduled  controller  synthesis. 

The  main  results  on  gain-scheduled  controller  synthesis  are  described  in  Chapter  5. 

1.2  Gain-scheduled  control  of  the  ONR  UCAV 

We  have  applied  the  results  on  gain-scheduled  controller  synthesis  towards  the  control  of  the  ONR  Unmanned 
Intelligent  Autonomous  Air  Vehicles  (UCAVs).  The  models  that  we  have  used  are  from  the  research  team 
from  Texas  A&M  University,  led  by  Professors  J unkins,  Ward  and  Valasek.  The  results  from  this  effort  are 
described  in  Chapter  6. 
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1.3  Robust  estimation 


A  second  research  direction  that  is  relevant  to  Dr.  Moshfegh’s  project  was  identified  during  the  January 
semi-annual  program  review,  held  in  January  1999. 

Estimation  problems  arise  in  many  naval  applications  in  control,  communications  and  signal  processing 
areas.  Traditional  estimation  algorithms  are  usually  based  on  a  nominal  system  model  without  uncertainty. 
However,  in  many  cases,  there  exist  uncertainties  in  model  parameters  and  even  model  structures  because  of 
modeling  errors  from  system  identifications.  These  uncertainties  may  degrade  the  estimation  performance 
of  the  algorithm  without  robustness. 

Figure  1.2  shows  a  block  diagram  of  the  problem  setting.  The  subscript  “A”  is  used  to  indicate  that  the 
plant  parameters  are  affected  by  the  uncertainties  A.  The  objective  is  to  design  a  filter  for  obtaining  optimal 
estimates  z  of  the  signal  of  interest  z,  with  different  optimality  criteria.  Chapter  7  describes  the  results  of 
our  robust  estimation  efforts. 


Figure  1.2:  Estimation  for  uncertain  linear  time- varying  systems. 


1.4  Availability  of  results 

The  results  from  this  project  have  been  documented  in  several  refereed  publications. 

1.4.1  Publications 

Journal  Publications 

1.  L.  Vandenberghe  and  V.  Balakrishnan.  “Algorithms  and  Software  for  LMI  Problems  in  Control”. 
IEEE  Control  Systems  Magazine,  pages  89-95,  October  1997. 

2.  A.  L.  Tits  and  V.  Balakrishnan.  “Small-// Theorems  with  Frequency- Dependent  Uncertainty  Bounds”. 
Mathematics  of  Control,  Signals,  and  Systems ,  vol  11,  no.  3,  pages  220-243,  1998. 

3.  A.  E.  Rundell,  R.  A.  DeCarlo,  V.  Balakrishnan  and  H.  HogenEsch.  “Investigations  into  Treatment 
Strategies  Aiding  the  Immune  Response  to  Haemophilus  Influenzae” .  IEEE  Trans.  Biomed.  Eng., 
vol.  45,  no.  4,  pages  429-439,  April  1998. 

4.  V.  Balakrishnan  and  R.  L.  Kashyap.  “Robust  Stability  and  Performance  Analysis  of  Uncertain  Systems 
Using  Linear  Matrix  Inequalities”.  Journal  of  Optimization  Theory  and  Applications ,  vol.  100,  no.  3, 
March  1999. 

5.  A.  L.  Tits,  V.  Balakrishnan  and  L.  Lee.  “Robustness  under  Bounded  Uncertainty  with  Phase  Infor¬ 
mation”.  IEEE  Trans.  Aut.  Contr.,  AC-44(l):50-65,  January  1999. 

6.  Y.  S.  Chou,  A.  L.  Tits  and  V.  Balakrishnan.  “Stability  multipliers  and  //  upper  bounds:  Connections 
and  implications  for  numerical  verification  of  frequency  domain  conditions”.  IEEE  Trans.  Aut.  Contr., 
AC-44(5):906-913,  May  1999. 
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7.  V.  Balakrishnan  and  F.  Wang.  “Efficient  Computation  of  a  Guaranteed  Lower  Bound  on  the  Robust 
Stability  Margin  of  Uncertain  Systems”.  IEEE  Trans.  Aut.  Contr .,  AC-44(11):2185-2190,  November 
1999. 

8.  C-Y.  Chang,  A.  A.  Maciejewski,  and  V.  Balakrishnan.  “Fast  Eigenspace  Decomposition  of  Correlated 
Images.”  Accepted  for  publication  in  IEEE  Transactions  on  Image  Processing ,  1999. 

Conference  papers  published 

1.  V.  Balakrishnan  and  L.  Vandenberghe.  “Linear  Matrix  Inequalities  for  signal  processing.  An  overview”. 
Invited  for  presentation  at  the  32nd  Annual  Conference  on  Information  Sciences  and  Systems ,  Depart¬ 
ment  of  Electrical  Engineering,  Princeton  University,  Princeton  NJ,  March  1998. 

2.  V.  Balakrishnan  and  F.  Wang.  “Efficient  Computation  of  a  Guaranteed  Lower  Bound  on  the  Robust 
Stability  Margin  of  Uncertain  Systems”.  In  Proc.  IEEE  Conf  on  Decision  and  Control ,  pages  4406- 
4407,  Tampa,  FL,  December  1998. 

3.  F.  Wang  and  V.  Balakrishnan.  “Improved  Stability  Analysis  and  Gain-Scheduled  Controller  Synthesis 
for  Parameter- Dependent  Systems”.  In  Proc.  IEEE  Conf.  on  Decision  and  Control ,  pages  1771-1776, 
Tampa,  FL,  December  1998. 

4.  F.  Wang  and  V.  Balakrishnan.  “Robust  Adaptive  Kalman  Filters  for  Linear  Time- Varying  Systems 
with  Stochastic  Parametric  Uncertainties.”  In  IEEE  American  Control  Conf. ,  pages  440-444,  San 
Diego,  CA,  June  1999.  Finalist,  best  student  paper  award. 

5.  F.  Wang  and  V.  Balakrishnan.  “Robust  Estimators  for  Systems  with  Both  Deterministic  and  Stochastic 
Uncertainties.”  In  IEEE  Conf  on  Decision  and  Control ,  Phoenix,  Arizona,  December  1999. 

6.  F.  Wang  and  V.  Balakrishnan.  “Robustness  analysis  and  gain-scheduled  controller  synthesis  for  rational 
parameter-dependent  uncertain  systems  using  parameter-dependent  Lyapunov  functions.”  In  IEEE 
Conf.  on  Decision  and  Control ,  Phoenix,  Arizona,  December  1999. 

1.4.2  Web-based  dissemination  of  results 

The  web-sites 

http : //www . ece . purdue . edu/~ragu/onr/gs- contr . html 
and 

http : //www . ece . purdue . edu/~ragu/onr/ rob-est . html 
have  been  established  to  disseminate  the  research  results.  The  first  web-site  also  has  instruction  for  down¬ 
loading  matlab  code. 
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Part  I 


Analysis  and  Gain-Scheduled  Control 


Chapter  2 

Robust  performance  analysis  using 
Lyapunov  functions 


A  wide  variety  of  problems  in  system  and  control  theory  can  be  formulated  (or  reformulated)  as  convex  optimization 
problems  involving  linear  matrix  inequalities  (LMIs),  that  is,  constraints  requiring  an  affine  combination  of  symmetric 
matrices  to  be  positive  semidefinite.  For  a  few  very  special  cases,  there  are  “analytical  solutions”  to  these  problems, 
but  in  general  they  can  be  solved  numerically  very  efficiently.  Thus,  the  reduction  of  a  control  problem  to  an 
optimization  problem  based  on  LMIs  constitutes,  in  a  sense,  a  “solution”  to  the  original  problem.  The  first  objective  of 
this  chapter  is  to  provide  a  tutorial  on  the  application  of  optimization  based  on  LMIs  to  robust  control  problems.  The 
second  objective  is  that  of  robust  stability  and  performance  analysis  of  uncertain  systems  using  LMI  optimization. 


2.1  Introduction 

A  wide  variety  of  problems  in  system  and  control  theory  can  be  reduced  to  a  handful  of  standard  convex 
and  quasiconvex  optimization  problems  that  involve  linear  matrix  inequalities  or  LMIs,  that  is  constraints 
of  the  form 

m 

F(x)  =  Fo  +  J2xiFi>0,  (2.1) 

1  =  1 

where  x  €  Rm  is  the  variable,  and  F{  =  F?  €  Rnxn,  i  =  0, . .  .,m,  are  given.  Though  the  form  of  the 
LMI  (2.1)  appears  very  specialized,  it  turns  out  that  it  is  widely  encountered  in  system  and  control  theory. 
Examples  include:  multicriterion  LQG,  synthesis  of  linear  state  feedback  for  multiple  or  nonlinear  plants 
(“multi-model  control”),  optimal  state-space  realizations  of  transfer  matrices,  norm  scaling,  synthesis  of 
multipliers  for  Popov-like  analysis  of  systems  with  unknown  gains,  robustness  analysis  and  robust  controller 
design,  gain-scheduled  controller  design,  and  many  others.  For  a  few  very  special  cases  there  are  “analytical 
solutions”  to  LMI  optimization  problems,  but  in  general  they  can  be  solved  numerically  very  efficiently. 
Indeed,  the  recent  and  growing  popularity  of  LMI  optimization  for  control  can  be  directly  traced  to  the 
recent  breakthroughs  in  interior  point  methods  for  LMI  optimization  (see  for  example,  [NN94]-[VB96]).  In 
many  cases— for  example,  with  multi-model  control  [BEFB94] — the  LMIs  encountered  in  systems  and  control 
theory  have  the  form  of  simultaneous  (coupled)  Lyapunov  or  algebraic  Riccati  inequalities;  using  interior- 
point  methods,  such  problems  can  be  solved  in  a  time  that  is  roughly  comparable  to  the  time  required 
to  solve  the  same  number  of  (uncoupled)  Lyapunov  or  Algebraic  Riccati  equations  [VB95].  Therefore  the 
computational  cost  of  extending  current  control  theory  that  is  based  on  the  solution  of  algebraic  Riccati 
equations  to  a  theory  based  on  the  solution  of  (multiple,  simultaneous)  Lyapunov  or  Riccati  inequalities  is 
modest. 

A  number  of  publications  can  be  found  in  the  control  literature  that  survey  applications  of  LMI  optimiza¬ 
tion  to  the  solution  of  system  and  control  problems.  Perhaps  the  most  comprehensive  list  can  be  found  in 
the  book  [BEFB94].  Since  its  publication,  a  number  of  papers  have  appeared  chronicling  further  applications 
of  LMI  optimization  techniques  in  control;  a  few  examples  are  [BE]  and  [VB97].  The  growing  popularity  of 
LMI  methods  for  control  is  also  evidenced  by  the  large  number  of  publications  in  recent  control  conferences. 
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Our  first  objective  in  this  chapter  is  to  give  a  brief  introduction  to  optimization  based  on  LMIs.  In  Sec¬ 
tion  2.2.1,  we  describe  a  few  “standard”  convex  and  quasiconvex  optimization  problems  involving  LMIs.  We 
make  a  few  brief  remarks  about  solving  LMI-based  optimization  problems  in  Section  2.2.2.  In  Section  2.2.3, 
we  present  a  brief  history  of  LMIs  in  system  and  control  theory. 

Our  second  objective  is  that  of  robust  stability  and  performance  analysis  of  uncertain  systems,  with 
various  assumptions  on  the  nature  of  the  uncertainties  (sector-bounded  nonlinear,  linear  time- invariant, 
parametric,  etc.),  as  well  as  their  structure  (diagonal,  block-diagonal,  etc.).  We  first  show,  in  Section  2.4, 
how  the  robust  stability  analysis  of  such  systems  can  be  performed  in  a  unified  manner  using  multiplier 
theory  and  LMI-based  convex  optimization.  Not  only  does  this  provide  a  unification  of  several  apparently- 
di verse  robust  stability  tests,  but  it  also  paves  the  way  for  developing  new  stability  tests.  In  addition, 
the  multipliers  used  in  the  stability  analysis  can  be  shown  to  yield  a  convex  parametrization  of  a  subset  of 
Lyapunov  functions  that  provide  a  certificate  of  robust  stability.  In  Section  2.5,  we  show  how  these  Lyapunov 
functions  can  in  turn  be  used  to  derive  bounds  on  various  robust  performance  measures  for  uncertain  systems. 
We  illustrate  our  approach  with  two  specific  robust  performance  analysis  problems. 


2.2  Optimization  Based  on  Linear  Matrix  Inequalities 

Recall  the  definition  of  a  linear  matrix  inequality: 

m 

F(x)  =  Fo  +  ^XiFiX), 


*  =  1 


where  x  €  Rm  is  the  variable,  and  F,-  =  F?  G  Rnxn,  i  =  0, . . .  ,m  are  given.  The  set  {x  \  F(x)  >  0} 
is  convex,  and  need  not  have  smooth  boundary.  (We  have  used  strict  inequality  mostly  for  convenience, 
inequalities  of  the  form  F(x)  >  0  are  also  readily  handled.) 

Multiple  LMIs  Fi(x)  >  0, . . . ,  Fn(x)  >  0  can  be  expressed  as  the  single  LMI 

diag(Fi(x), . . . ,  Fn(x))  >  0. 

When  the  matrices  F;  are  diagonal,  the  LMI  F{x)  >  0  is  just  a  set  of  linear  inequalities.  Nonlinear 
(convex)  inequalities  are  converted  to  LMI  form  using  Schur  complements.  The  basic  idea  is  as  follows,  the 
LMI 


>0, 


Q(x)  S(x) 

[  S(x)T  R(x)  J 

where  Q(x)  =  Q(x)T ,  R(x)  =  R(x)T ,  and  S(x)  depend  affinely  on  x,  is  equivalent  to 

R(x)  >  0,  Q(x)  -  S(x)R(x)~1S(x)T  >  0. 


(2.2) 


(2.3) 


>  0 


In  other  words,  the  set  of  nonlinear  inequalities  (2.3)  can  be  represented  as  the  LMI  (2.2). 

The  matrix  norm  constraint  ||Z(x)[|  <  1,  where  Z(x)  G  Rpx<!  and  depends  affinely  on  x ,  is  represented 
as  the  LMI 

I  Z(x) 

_  Z(x)T  I 

(since  \\Z\\  <  1  is  equivalent  to  I-ZZT  >  0).  Note  that  the  case  q  =  1  reduces  to  a  general  convex  quadratic 
inequality  on  x. 

The  constraint 

Tr  S(x)T P(x)~1  S(x)  <  1,  P{x)  >  0, 

where  P(x)  =  P(x)T  G  Rnxn  and  S(x)  G  Rnxp  depend  affinely  on  x,  is  handled  by  introducing  a  new 
(slack)  matrix  variable  X  —  XT  G  Rpxp,  and  the  LMI  (in  x  and  X): 

t  X  S(x)T  ] 

TtX  <  l’  [  5(x)  P{x)  \  >  °' 


We  often  encounter  problems  in  which  the  variables  are  matrices,  e.g. 

AtP  +  PA  <  0, 


(2.4) 
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where  A  £  Rnxn  is  given  and  P  =  PT  is  the  variable.  In  this  case  we  will  not  write  out  the  LMI  explicitly 
in  the  form  F(x)  >  0,  but  instead  make  clear  which  matrices  are  the  variables.  Leaving  LMIs  in  a  condensed 
form  such  as  (2.4),  in  addition  to  saving  notation,  leaves  open  the  possibility  of  more  efficient  computation. 

2.2,1  Some  Standard  LMI  Optimization  Problems 

(i)  LMI  Feasibility  Problems 

Given  an  LMI  F(x)  >  0,  the  corresponding  LMI  feasibility  problem  is  to  find  xfeas  such  that  F(xfeas)  >  0 
or  determine  that  the  LMI  is  infeasible.  (By  duality,  this  means:  find  a  nonzero  G  >  0  such  that  Tr  GF{  =  0 
for  i  =  1, . . . ,  m  and  Tr  GF0  <  0.)  Of  course,  this  is  a  convex  feasibility  problem. 

(ii)  Eigenvalue  Problems 

The  eigenvalue  problem  is  to  minimize  the  maximum  eigenvalue  of  a  matrix,  subject  to  an  LMI: 

min  A 

s.t.  XI  —  A(x)  >  0,  B(x)  >  0. 

Here,  A  and  B  are  symmetric  matrices  that  depend  affinely  on  the  optimization  variable  x.  This  is  a  convex 
optimization  problem. 

(iii)  Generalized  Eigenvalue  Problems 

The  generalized  eigenvalue  problem  is  to  minimize  the  maximum  generalized  eigenvalue  of  a  pair  of 
matrices  that  depend  affinely  on  the  optimization  variable,  subject  to  an  LMI  constraint.  The  general  form 
of  a  generalized  eigenvalue  problem  is: 


min  A 

s.t.  A B(x)  —  A(x)  >  0 

B(x)  >  0 
C(x)  >  0 

where  A,  B  and  C  are  affine  functions  of  x.  This  is  a  quasiconvex  problem. 

Note  that  when  the  matrices  are  all  diagonal,  this  problem  reduces  to  the  general  linear  fractional 
programming  problem.  Many  nonlinear  quasiconvex  functions  can  be  represented  in  the  form  of  a  generalized 
eigenvalue  problem  with  appropriate  A ,  B ,  and  C  (see  [BE93]). 

2.2.2  Solving  LMI-Based  Problems 

The  most  important  point  is: 

LMI  feasibility,  eigenvalue  and  generalized  eigenvalue  problems  are  all  tractable 

in  a  sense  that  can  be  made  precise  from  a  number  of  theoretical  and  practical  viewpoints.  (This  is  to  be 
contrasted  with  much  less  tractable  problems,  e.g.,  the  general  problem  of  robustness  analysis  for  a  system 
with  real  parameter  perturbations.) 

From  a  theoretical  standpoint: 

•  We  can  immediately  write  down  necessary  and  sufficient  optimality  conditions. 

•  There  is  a  well-developed  duality  theory  (for  generalized  eigenvalue  problems,  in  a  limited  sense). 

•  These  problems  can  be  solved  in  polynomial  time  (indeed  with  a  variety  of  interpretations  of  the  term 
“poly  nomial-time” ) . 

The  most  important  practical  implication  is  that  there  are  effective  and  powerful  algorithms  for  the 
solution  of  these  problems,  that  is,  algorithms  that  rapidly  compute  the  global  optimum,  with  non-heuristic 
stopping  criteria.  Thus,  on  exit,  the  algorithms  can  prove  that  the  global  optimum  has  been  obtained  to 
within  some  prespecified  accuracy. 

There  are  a  number  of  general  algorithms  for  the  solution  of  LMI  problems,  for  example,  the  ellip¬ 
soid  algorithm  (see  e.g.,  [BB91]  and  [BGT81]).  The  ellipsoid  method  has  polynomial-time  complexity,  and 
works  in  practice  for  smaller  problems,  but  can  be  slow  for  larger  problems.  Other  algorithms  specifically 
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for  LMI-based  problems  are  discussed  in,  e.g.,  [CDW75]  and  [Ove88].  More  recently,  various  researchers 
([Ali95]— [VB96] )  have  developed  interior  point  methods  for  solving  LMI-based  problems,  based  on  the  work 
of  Nesterov  and  Nemirovskii  [NN94].  Numerical  experience  shows  that  these  algorithms  solve  LMI  problems 
with  great  efficiency.  A  survey  of  algorithms  and  software  for  LMI  optimization  can  be  found  in  [VB97]. 

A  number  of  software  packages  are  also  available  for  solving  LMI  problems.  The  first  implementation  of 
an  interior-point  method  for  LMI  problems  was  by  Nesterov  and  Nemirovskii  in  [NN90],  using  the  projective 
algorithm  [NN94].  Matlab’s  LMI  Control  Toolbox  [GNLC95]  is  based  on  the  same  algorithm,  and  offers  a 
graphical  user  interface  and  extensive  support  for  control  applications.  The  code  SP  [VB94]  is  based  on  a 
primal-dual  potential  reduction  method  with  the  Nesterov  and  Todd  scaling.  The  code  is  written  in  C  with 
calls  to  BLAS  and  LAPACK  and  includes  an  interface  to  Matlab.  SDPSOL  [WB96]  and  LMITOOL  [END95] 
offer  user-friendly  interfaces  to  SP  that  simplify  the  specification  of  LMI  problems  where  the  variables  have 
matrix  structure.  The  Induced-Norm  Control  Toolbox  [Ber95]  is  a  toolbox  for  robust  and  optimal  control, 
in  turn  based  on  LMITOOL. 

2.2.3  Brief  History  of  LMIs  in  System  and  Control  Theory 

The  history  of  linear  matrix  inequalities  in  the  analysis  of  dynamical  systems  goes  back  more  than  100  years, 
when  Lyapunov  published  his  seminal  work  introducing  what  we  now  call  Lyapunov  theory.  He  showed  that 
the  differential  equation 

=  Ax(t)  (2.5) 

is  stable  if  and  only  if  there  exists  a  positive  definite  matrix  P  such  that 

AtP  +  PA<  0.  (2.6) 

The  requirement  P  >  0,  ATP  +  PA  <  0  is  what  we  now  call  a  Lyapunov  inequality  on  P,  which  is  a  special 
form  of  an  LMI.  Of  course,  we  can  solve  this  LMI  (that  is,  find  a  suitable  P)  by  solving  a  Lyapunov  equation. 

The  next  major  development  was  in  the  1940s  when  Lur’e,  Postnikov,  and  others  in  the  Soviet  Union  ap¬ 
plied  Lyapunov’s  methods  to  some  specific  practical  problems  in  control  engineering,  especially,  the  problem 
of  stability  of  a  control  system  with  a  nonlinearity  in  the  actuator  [Lur57].  Although  they  did  not  explic¬ 
itly  form  matrix  inequalities,  their  stability  criteria  in  fact  have  the  form  of  LMIs.  These  inequalities  were 
reduced  to  polynomial  inequalities  which  were  then  checked  “by  hand”  (for,  needless  to  say,  small  systems) . 

Then,  in  the  1960s,  Yakubovich,  Popov,  Kalman,  and  other  researchers  succeeded  in  reducing  the  solution 
of  the  LMIs  that  arose  in  the  problem  of  Lur’e  to  simple  graphical  criteria,  using  what  we  now  call  the 
Kalman- Yakub ovich- Popov  (KYP)  lemma.  This  resulted  in  the  celebrated  Popov  criterion,  Circle  criterion, 
Tsypkin  criterion,  and  many  variations.  These  criteria  could  be  applied  to  higher  order  systems,  but  did 
not  gracefully  or  usefully  extend  to  systems  containing  more  than  one  nonlinearity.  Thus,  their  contribution 
may  be  viewed — in  the  context  of  the  history  of  LMIs  in  control  theory — as  showing  how  to  solve  a  certain 
family  of  LMIs  by  a  graphical  method.  We  should  note  that  the  important  role  of  LMIs  in  control  theory 
was  already  recognized  in  the  early  1960s,  especially  by  Yakubovich  [Yak67]. 

By  1971,  researchers  knew  several  methods  for  solving  special  types  of  LMIs:  direct  (for  very  small 
systems),  graphical  methods,  and  by  solving  Lyapunov  or  Riccati  equations.  In  Willems’  1971  paper  [Wil71] 
we  find  the  following  striking  quote: 

The  basic  importance  of  the  LMI  seems  to  be  largely  unappreciated.  It  would  be  interesting  to 
see  whether  or  not  it  can  be  exploited  in  computational  algorithms,  for  example. 

Willems’  suggestion  that  LMIs  might  have  some  advantages  in  computational  algorithms  became  closer  to 
being  realized  with  the  following  observation: 

The  LMIs  that  arise  in  system  and  control  theory  can  be  formulated  as  convex  optimization 
problems ,  and  hence  are  amenable  to  computer  solution. 

This  observation  was  made  explicitly  by  several  researchers:  Pyatnitskii  and  Skorodinskii  [PS82],  and  Ho- 
risberger  and  Belanger  [HB76],  to  name  just  a  few.  This  observation,  coupled  with  the  development  of 
interior  point  methods  that  apply  directly  to  convex  problems  involving  matrix  inequalities,  by  Nesterov  and 
Nemirovskii  in  1988,  now  mean  that  we  can  reliably  and  quickly  solve  many  problems  in  systems  and  control 
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for  which  no  “analytical  solution”  has  been  found  (or  is  likely  to  be  found),  by  reducing  to  them  to  LMI 
problems.  The  efficient  solution  of  LMI  optimization  problems  as  well  as  the  numerical  solution  of  several 
diverse  engineering  problems  via  LMI  optimization  remain  areas  of  active  research. 


2.3  Robust  Stability  and  Performance  Analysis  of  Uncertain  Sys¬ 
tems:  Overview 

Most  control  system  models  in  use  today  explicitly  incorporate  in  them  “uncertainties”  or  “perturbations”. 
These  uncertainties  may  model  a  number  of  factors,  including:  dynamics  that  are  neglected  to  make  the 
model  tractable,  as  with  large  scale  structures;  nonlinearities  that  are  either  hard  to  model  or  too  complicated; 
and  parameters  that  are  not  known  exactly,  either  because  they  are  hard  to  measure  or  because  of  varying 
manufacturing  conditions.  A  widely-used  model  for  uncertain  systems,  shown  in  Fig.  2.4,  consists  of  a 
nominal  finite-dimensional,  stable,  linear  time-invariant  system,  with  a  perturbation  or  uncertainty  A  in  a 
feedback  loop.  The  signal  w  represents  exogenous  inputs,  and  z  represents  all  outputs  of  interest.  Often 
additional  information  about  A  is  either  known  or  assumed;  common  examples  are  that  A  is  diagonal  or 
block-diagonal;  sector-bounded  memoryless,  linear  time-invariant  or  parametric;  bounded  in  norm,  passive, 
etc.  The  analysis  of  and  design  for  such  control  system  models  is  commonly  referred  to  as  “robust  control 
with  structured  perturbations” . 

One  of  the  most  fundamental  questions  concerning  the  system  in  Fig.  2.4  is  that  of  stability:  “Is  the 
model  stable  irrespective  of  the  perturbation  A,  that  is,  do  all  solutions  of  the  system  equations  go  to  zero, 
irrespective  of  A?”  This  is  also  referred  to  as  the  robust  stability  problem.  Some  of  the  approaches  for  solving 
this  problem,  with  various  assumptions  on  A,  are  the  use  of  the  small-gain,  passivity  or  circle-criteria  [DV75], 
the  Popov  criterion  [LP44],  and  fi  or  Km  analysis  methods  ([Doy82]-[CS92]).  Robust  stability  is  but  one 
desired  feature  of  an  uncertain  system;  of  considerable  importance  are  questions  beyond  stability,  known 
broadly  as  robust  performance  problems.  Robust  performance  analysis  problems  concern  the  computation 
of  the  worst  possible  value,  over  all  uncertainties,  of  performance  indices;  these  performance  indices  may  be 
bounds  on  some  state  variables,  norms  of  the  map  from  w  to  z  etc.  An  example  of  a  robust  performance 
analysis  problem  is  the  so-called  H2  problem,  which  is  the  computation  of  the  largest  possible  RMS  value 
of  the  output  z,  over  all  A,  when  the  input  w  is  unit-intensity  white  noise.  This  finds  application  where  the 
average  value  of  a  certain  signal  is  of  interest,  when  the  system  is  affected  by  an  unpredictable  input  that 
is  modeled  as  white  noise.  Another  example  is  the  computation  of  the  largest  possible  RMS  gain,  over  all 
uncertainties,  from  w  to  z;  this  is  also  known  as  the  Hqo  performance  analysis  problem. 

It  has  been  found  recently  that  several  stability  analysis  methods  for  control  systems  can  be  unified  in 
the  setting  of  multiplier  theory  ([DV75]  and  [SC93]-[GS95]),  or  more  generally,  in  the  framework  of  integral 
quadratic  constraints  or  IQCs  [MR97],  (While  the  framework  of  IQCs  is  more  general  than  the  multipier- 
based  framework,  we  have  chosen  to  present  the  latter  here  for  “historical”  reasons.)  As  a  consequence, 
several  sufficient  conditions  for  robust  stability  can  be  performed  without  frequency  sampling,  using  convex 
optimization  techniques  based  on  LMIs  [Bal95];  we  describe  this  in  Section  2.4.  It  also  turns  out  that 
the  multiplier  techniques  yield  a  convex  parametrization  of  a  set  of  Lyapunov  functions  that  prove  robust 
stability  [Bal94a].  By  imposing  additional  conditions  on  these  Lyapunov  functions,  bounds  on  the  robust 
performance  for  the  system  in  Fig.  2.4  can  be  derived;  thus  Lyapunov  functions  can  be  used  to  “prove”  robust 
performance  as  well.  The  “best”  performance  bounds  can  then  be  obtained  by  numerically  optimizing  these 
bounds,  using  LMI-based  methods,  over  the  set  of  Lyapunov  functions  that  prove  robust  performance.  We 
describe  this  approach  in  Section  2.5. 

2.4  Robust  Stability  Using  Multiplier  Theory 

Let  the  equations  governing  the  system  in  Fig.  2.4  be: 

4;x{t)  =  Ax(t)  +  Bpp(t)  +  Bww(t),  q(t)  =  Cqx(t)  +  Dqpp(t),  z(t)  =  Czx(t),  (2.7a) 

at 

p(t)  = -A(q,t),  (2.7b) 

where  x(t)  G  R”,  p{t)  £  R"1’,  q(t)  E  R"'1,  w(t)  E  R"”  and  z(t)  E  Rn‘.  For  convenience,  we  have  assumed 
that  there  is  no  feed-through  from  w  to  z,  w  to  q  and  p  to  z;  we  will  also  assume  that  np  —  nq  =  m.  For 
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future  reference,  we  let  C  denote  the  linear  system  (2.7a),  and  G  the  transfer  function  of  the  linear  part  of 
the  system  from  p  to  i.e.,  G(s)  —  Cq(sl  —  A)~l Bp  +  Dqp-  £*  is  assumed  to  be  stable.  Equations  (2.7)  can 
be  interpreted  either  as  representing  a  “family  of  systems”,  each  member  corresponding  to  some  A,  or  as  an 
“uncertain  system”  with  uncertainty  A;  we  will  use  these  terms  interchangeably.  The  perturbation  A  is  in 
general  nonlinear,  and  is  assumed  to  be  passive,  that  is,  the  following  holds5: 

For  some  e  >  0  and  /?  E  R, 

f  u(t)T(Au)(t)  dt>  e  f  u(t)Tu(t)  dt-  f3  for  all  T  >  0  and  all  ue  L2. 

Jo  Jo 

We  let  V  denote  the  set  of  all  passive  operators  A. 


Remark  2.4.1  Another  frequently  encountered  class  of  uncertainties  are  bounded  uncertainties,  that  is, 
those  A  with  an  L2  gain  that  does  not  exceed  some  7  >  0.  However,  it  is  well-known  (for  example, 
see  [And72]  that  under  standard  assumptions,  one  may  use  loop  transformations  to  transform  the  case  of 
norm-bounded  A  to  the  case  of  passive  A  considered  here. 

We  say  that  the  family  of  systems  (2.7)  is  robustly  stable  if  with  w  identically  zero,  for  every  member 
of  the  family  and  for  every  initial  condition,  every  solution  x(t)  of  (2.7)  satisfies  lim^oo  %(t)  =  0.  Our  first 
objective  is  to  show  how  the  robust  stability  analysis  of  the  family  of  systems  (2.7)  can  be  performed  using 
LMI  optimization. 

2.4.1  Robust  Stability  from  the  Passivity  Theorem 

Since  A  is  known  to  be  passive,  the  passivity  theorem  [DV75]  can  be  invoked  to  establish  robust  stability  of 
the  system  (2.7): 

The  uncertain  system  (2.7)  is  robustly  stable  if  the  (linear)  map  from  p  to  q  is  strictly  passive, 
that  is,  there  exist  e  >  0  and  /?  E  R  such  that  for  all  p  E  L2,  the  condition 

f  p(t)Tq(t)  dt  >  e  f  p(t)Tp(t)  dt  -  (3  for  all  T  >  0 
Jo  Jo 

holds,  where  p  and  q  satisfy  (2.7a)  with  w  identically  zero. 

Strict  passivity  of  the  map  from  p  to  q  is  equivalent  [DV75]  to  the  frequency- domain  condition  that  for 
some  e  >  0, 

G(ju)  +  G(ju)*  >  2 el  for  all  w  E  R-  (2.8) 

(If  this  holds,  we  will  say  with  some  abuse  of  terminology  that  “G(s)  is  strictly  passive”.)  This  condition 
can  be  numerically  verified  (approximately)  by  checking  that  the  minimum  eigenvalue  of  G(jw)  +G(jo;)*, 
sampled  at  a  number  of  frequencies,  is  positive.  An  alternate  condition  for  strict  passivity  that  avoids 
frequency  sampling  is  expressed  in  terms  of  an  LMI. 

b  For  precise  technical  definitions,  mathematical  preliminaries,  and  the  notation  used  here,  see  [DV75]  and  [Vid93]. 
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Lemma  2.4.1  Let  (A,  Bp ,  Cq,  Dqp)  be  a  state-space  realization  of  a  stable  linear  system  with  transfer 
function  G(s).  Then,  G  satisfies  (2.8)  if  and  only  if  there  exists  P  -  PT  >  0  satisfying  the  LMI 


AtP  +  PA  PBp  —  CT 
BTpP-Cq  ~(Dqp  +  Djp) 


<0. 


(2.9) 


This  is  simply  the  Kalman-Yakubovich-Popov  Lemma  or  the  Positive- Real  Lemma  (see  for  example,  [NT73], 
[Vid93],  pages  474-478,  and  [AV73],  Chapters  5-7;  see  also  [Ran96]). 

Remark  2.4.2  We  also  have  the  following  extension  of  Lemma  2.4.1.  Let  ( A ,  Bp>  Cq,  Dqp)  be  a  realization 
of  a  not  necessarily  stable  linear  system  with  transfer  function  G(s),  with  A  having  no  eigenvalues  on  the 
imaginary  axis.  Then,  G  satisfies  condition  (2.8)  if  and  only  if  there  exists  P  —  P  satisfying  the  LMI 


'  ATP  +  PA  PBp  -  CT 
BjP-Cq  ~(Dqp  +  Djp) 


<0. 


(2.10) 


2.4.2  Multiplier  Analysis 

Suppose  A  e  T>  also  possesses  additional  properties,  such  as  being  diagonal  or  block-diagonal,  sector-bounded 
memoryless,  linear  time-invariant  or  parametric,  etc.  Let  Instruct  —  ®  denote  the  set  of  A  satisfying  these 
additional  properties.  (We  will  see  two  specific  cases  for  ^struct  in  Example  2.5.1  and  Example  2.5.2.)  Then 
the  passivity  theorem  yields  only  a  sufficient  condition  for  robust  stability.  In  this  case,  we  can  employ 
multiplier  theory  to  utilize  the  additional  information  on  A  in  order  to  obtain  less  conservative  conditions 
for  robust  stability;  see  for  example,  [DV75]  and  [SC93]-[Bal95]. 


Consider  the  system  in  Fig.  2.4.2,  where  W+(s)  and  W.  (s)  are  transfer  functions  of  some  finite-dimensional 
LTI  systems.  Moreover,  suppose  that  W+(s)  and  W_(s)  satisfy 

W+(s)  and  W_(-s)  are  stable  with  stable  inverses.  (2.11) 

The  equations  governing  the  system  in  Fig.  2.4.2  are: 

- l-x(t )  —  Ax(t)  +  Bpp(t)  +  Bww(t)>  q(t)  =  Cqx(t)  +  Dqpp(t ),  z(t)  =  C2x(t),  (2.12a) 

at 

p(t)  =  -A (g,  0,  p(0  =  *p)(0>  9(0  =  (w+  *  9)(0>  (2.12b) 

where  wZ  and  w+  are  the  inverse  Laplace  transforms  of  fy_(-s)T  and  W+{s)  respectively,  and  V’  denotes 
convolution. 

We  have  the  obvious  but  important  connection  between  the  solutions  of  the  equations  (2.12)  and  (2.7). 
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Lemma  2.4.2  For  every  A  G  ^struct,  x  satisfies  (2.7)  if  and  only  if  it  satisfies  (2.12)  for  some  (every)  W+ 
and  W. _  satisfying  condition  (2.11).  Therefore,  system  (2.7)  is  robustly  stable  if  and  only  if  system  (2.12)  is 
robustly  stable,  for  some  (every)  W+  and  W-  satisfying  condition  (2.11). 

Next,  suppose  that 

for  every  A  G  ^struct,  W-(-s)T  o  A  o  W+(s)_1  is  passive.  (2.13) 


Then  from  the  passivity  theorem,  system  (2.12)  is  stable  if 

bF+(s)G(s)FF_(-s)_T  is  strictly  passive. 


(2.14) 


Thus,  if  we  find  some  W+  and  such  that  conditions  (2.13)  and  (2.14)  hold,  we  have  then  established 
the  robust  stability  of  system  (2.7).  Robust  stability  methods  using  multiplier  theory  involve  systematically 
searching  for  W+  and  W-  satisfying  (2.11)  such  that  conditions  (2.13)  and  (2.14)  hold.  Every  pair  of  such 
W+  and  W-  is  called  a  “multiplier  pair  proving  robust  stability” . 

It  turns  out  that  searching  directly  for  W+  and  W-  is  numerically  “hard” ,  as  the  set  of  multiplier  pairs 
that  prove  robust  stability  is  non  convex  in  general. 


Remark  2.4.3  Numerical  counterexamples  that  establish  that  the  set  of  constant  multiplier  pairs  that  prove 
robust  stability  is  not  necessarily  convex  are  easy  to  find.  Here  is  a  simple  one,  with  G  being  a  linear  system 
with  no  dynamics,  i.e. ,  with  transfer  matrix  a  constant: 


G(s)  = 


1.30 

0.20 

-0.10 


0.30 

0.50 

-0.60 


-0.40 

0.10 

0.80 


For  this  system,  it  is  easily  checked  numerically  that  the  multiplier  factors  with  no  dynamics 


(\  0.70  0  0 

0  1.0  0 

\[  0  0  1.3 


0.70  0  0  ]\ 

0  1.0  0 
0  0  1.3  J  / 


and 


/[  1.2  0  0 

0  -1.5  0 

\[  0  0  0.3 


1.2  0 

0  -1.5 

0  0 


both  prove  robust  stability,  but  their  average 

(\  0.95  0  0 

0  -0.25  0 

\[  0  0  0.80 


0.95  0  0  ]\ 

0  -0.25  0 

0  0  0.80  J  / 


does  not. 


2.4.3  Robust  Stability  via  LMI  Feasibility  Tests 

A  simple  change  of  variables  enables  the  reformulation  of  the  problem  of  search  of  multiplier  pairs  into 
a  convex  feasibility  problem.  The  central  idea  underlying  the  reformulation  is  that  we  should  regard  the 
product  W(s)  =  W_(s)W+(s)  as  the  variable;  this  product,  which  we  shall  denote  by  W(s)  is  called  the 
stability  multiplier  or  just  “multiplier”.  We  will  say  that  the  multiplier  W  “proves  robust  stability”  if  it 
can  be  factored  into  W(s)  =  W_(s)W+(s),  with  the  pair  {W-,  W+}  proving  robust  stability,  i.e.,  such  that 
conditions  (2.11),  (2.13)  and  (2.14)  hold.  It  can  be  shown  (see  [Bal95]  and  [CTB97a]  for  details)  that  these 
conditions  are  equivalent,  in  several  important  cases,  to  the  following  conditions: 


•  W  should  have  a  certain  structure  (e.g.,  diagonal  or  block-diagonal)  and  nature  (e.g.,  con-  (2-15) 
stant,  Hermitian  on  the  imaginary  axis,  etc.),  depending  on  the  additional  information 

known  about  Struct-  (For  specific  examples,  see  [Bal95].) 

•  For  some  e  >  0,  W(ju>)  -f  W(ju>)*  >  2 el  for  all  w  G  R  •  (2-16) 

•  For  some  e  >  0,  W (ju>)G(ju)  +  G(ju>yW(ju>)*  >  2 el  for  all  u>  G  R.  (2- 17) 

Thus,  establishing  robust  stability  using  multiplier  theory  involves  numerically  searching  for  a  multiplier 
W  that  satisfies  conditions  (2.15)-(2.17)  above.  The  important  observation  regarding  this  reformulation  is 
the  following. 


15 


Finding  W  that  satisfies  conditions  (2.15)-(2.17)  is  a  (possibly  infinite- dimensional)  convex  fea- 
sibility  problem. 

Additionally  restricting  W>  if  necessary,  to  lie  in  a  finite-dimensional  subspace  results  in  &  finite- dimensional 
convex  feasibility  problem.  Specifically,  suppose  that  W  is  restricted  to  lie  in  the  subspace 


W 


{m 


9eR" 


(2.18) 


where  Wi  are  fixed  transfer  matrices,  each  satisfying  the  structure  and  nature  condition  that  is  to  be  satisfied 
by  W  (see  (2.15)).  Then,  every  W  €  W  has  a  realization  (Aw,  Bw,  Gw(0),  Dw(0)),  with  Cw  and  L>w 
being  linear  functions  of  9.  Using  the  remark  following  Lemma  2.4.1,  we  conclude  that  condition  (2.16)  is 
equivalent  to  the  LMI  in  Pw  =  Pw  anc* 


A^,Pw  +  PwAw  PwPw  —  C\v(9)T 

B^vPv/  —  C\v(6)  —(Dw(6)  +  D-w(0)t) 


<  0. 


(2.19) 


Next,  WG  has  a  state-space  realization  {Awg,  Bwg,  Cwg,  Dwg )  where 


Awg  = 


A  0 

BwC  Aw 


Bwg  (6)  = 


B 

By/  D  1 


Cwg  —  [Dw(0)C  Cy/(0)\ ,  Dwg  (6)  ~ 


Note  that  Cwg  and  Dwg  are  linear  functions  of  6.  Then,  checking  condition  (2.17)  is  equivalent  to  the  LMI 
in  P  —  PT  and  0: 

’  A^gP  +  PAWg 


<0. 


(2.20) 


PBwg  —  Cwg(@)t 

[  B^gP  -  Cwg(Q)  ~  (Dwg(0)  +  Dwg{Q)t)  J 

Thus  sufficient  conditions  for  robust  stability,  in  several  important  cases,  can  be  posed  as  the  following 
feasibility  problem: 

Find  Py/,  P  and  Q  such  that  the  LMIs  (2.19)  and  (2.20)  hold.  (2.21) 


The  above  formulation  of  robust  stability  tests  is  important  in  several  different  ways: 

(i)  Robust  stability  can  be  ascertained  using  state-space  techniques  and  reliable  convex  optimization;  there 
is  no  frequency  sampling  involved  with  LMI  tests. 

(ii)  A  number  of  classical  and  modern  robust  stability  tests  can  be  unified  in  this  setting  (for  example, 
several  tests  for  absolute  stability,  as  well  as  the  modern  \i  tests;  see  [Bal95]). 

(iii)  New  tests  can  be  devised,  when  other  assumptions  on  the  uncertainties  are  in  effect  (see  for  exam¬ 
ple,  [TBL99],  as  well  as  [MR97]). 

In  addition,  the  LMI  tests  for  robust  stability  can  be  shown  to  yield  Lyapunov  functions  that  “prove” 
robust  stability  (see  for  example  [Bal94a]).  These  Lyapunov  functions  can  in  turn  be  used  to  derive  bounds 
on  robust  performance.  We  describe  this  next. 


2.5  Robust  Performance  Bounds  from  Lyapunov  Functions 

The  multiplier-based  robust  stability  condition  (2.21)  can  be  shown  to  yield  a  positive-definite  function 
V  :  Rn  x  R+  — ►  R+  such  that  dV{x,t)/dt  <  0  along  the  trajectories  of  (2.7).  (This  function  V  can  be 
constructed  from  the  LMI  variables  P,  Pw  and  0;  we  will  see  a  demonstration  of  this  in  Example  2.5.1  and 
Example  2.5.2.)  Using  standard  arguments  from  Lyapunov  theory,  it  can  be  shown  that  V  is  a  Lyapunov 
function  that  provides  a  certificate  or  guarantee  of  robust  stability.  Additional  conditions  on  the  Lyapunov 
function  can  be  imposed,  yielding  robust  performance  bounds  as  follows  (see  for  example  [AC84],  Section  6, 
and  [BEFB94]):  For  a  given  initial  condition  ar(0)  for  the  linear  part  (2.7a),  suppose  that  the  Lyapunov 
function  V  satisfies 

—  V(x,t)  <  —<j>a(x(t)}w(t)}z(t))  along  the  trajectories  of  (2.7).  (2.22) 

dt 
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Then  it  is  a  simple  exercise  to  show  that 


poo 

y(*(0),0)>  /  <j>a(x{t),w(t),z(t))dt, 

Jo 

or  we  have  an  upper  bound  on  the  performance  index 

poo 

Pa  —  I 
Jo 


(2.23) 


(2.24) 


Thus,  if  we  can  find  a  Lyapunov  function  V  satisfying  (2.22),  then  we  can  obtain  upper  bounds  on  robust 
performance  indices  of  the  form  (2.24),  for  system  (2.7).  (A  variation  of  this  technique  can  be  used  to  obtain 
bounds  on  more  general  performance  measures;  see  for  example  [BEFB94],  Chapters  5-6.) 

We  will  see  in  Example  2.5.1  and  Example  2.5.2  that  imposing  condition  (2.22)  on  the  Lyapunov  functions 
obtained  from  multiplier  theory  leads  to  LMI  conditions  in  several  important  cases.  Consequently,  in  all  these 
cases,  the  problem  of  computing  the  optimal  (or  smallest)  robust  performance  bound  can  be  reformulated 
as  an  LMI  optimization  problem. 


Example  2.5.1  Unstructured  Passive  A,  Bound  on  the  Output  Energy 

Consider  the  case  when  A  is  a  general  passive  operator,  with  the  performance  analysis  problem  being: 

With  w  =  0,  find  a  bound  on  the  energy  of  the  output,  i.e.,  /0°°  z(t)T z(t)  dt ,  for  a  given  initial 
condition  z(0)  of  the  state  of  the  linear  part  of  the  system. 

In  order  to  derive  upper  bounds  on  /0°°  z(t)T  z(t)  dt ,  we  seek  Lyapunov  functions  that  satisfy  condi¬ 
tion  (2.22)  with  <f>a(x ,  wy  z)  =  zTz,  i.e., 

4 v(x,t)  < -z(t)T z(t).  (2.25) 

at 


Then  V" (a?(0),  0)  yields  an  upper  bound  on  the  output  energy. 

Since  A  is  a  general  passive  operator,  the  only  possible  multiplier  pair  is  given  by  W+  =  W-  =  I.  The 
corresponding  Lyapunov  functions  turn  out  (see  [Wil72a]  and  [Wil72b])  to  be  of  the  form 


V(x,t)  =  x(t)TPz(t)-2 


dr , 


where  P  >  0.  Condition  (2.25)  holds  along  the  trajectories  of  system  (2.7)  if  the  following  condition  holds: 


’  AtP  +  PA  +  CJCz  PBp  —  CT 

BjP  —  Cq  ~(Dqp  +  Djp) 


<0. 


(2.26) 


Thus,  the  best  upper  bound  on  the  energy 
system,  is  simply 


mm 


of  z,  for  a  given  initial  condition  x(0)  of  the  linear  part  of  the 
x{0)TPx(0) 


s.t.  P  >  0,  and  (2.26) 

This  is  an  “eigenvalue  problem”  (see  Section  2.2.1). 

Example  2.5.2  Diagonal,  Time- In  variant,  Sector-Bounded,  Memoryless  Nonlinearities  A,  Bound 
on  the  State  Variables 

Next,  consider  the  case  when:  Dqp  is  zero;  the  uncertainty  A  is  diagonal,  i.e.,  pi(t)  =  —£*(?*(t));  and 
each  is  a  time-invariant,  memoryless  nonlinearity  in  sector  [0,oo)  (see  [DV75]  for  the  definitions  of  the 
various  terms  used  here).  For  this  case,  the  performance  analysis  problem  considered  is: 

With  exogenous  input  w  =  0,  find  bounds  on  the  state  x(t)y  t  >  0,  of  the  linear  part  of  the 
system,  for  a  given  initial  condition  x(0). 
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In  other  words,  we  seek  an  invariant  set  for  the  trajectories  x(t)  of  the  linear  part  of  the  system.  For 
every  positive-definite  function  V  for  which  dV(x,t)/dt  <  0  holds  along  the  trajectories  of  system  (2.7),  we 
have 

V{x(t),t)  <  V^(x(0),0)  for  t  >  0. 

This  inequality  can  then  be  used  to  derive  bounds  on  x(t). 

For  the  case  of  diagonal,  time-invariant,  sector-bounded,  memoryless  nonlinearities,  the  multiplier  pairs 
for  robust  stability  turn  out  to  be  W-  —  I  and 


W+(s)  =  diag((Ai  +/ti s), . . . ,  (Am  +  nms)), 


where  //j  >  0,  A ,♦  >  0.  (This  corresponds  to  a  multivariable  version  of  the  Popov  criterion  [DV75].)  The 
corresponding  Lyapunov  functions  are  of  the  form 


m  /•?*(*)  m  ft 

V(x,t)  =  x(t)T Px(t)  +  2  V\j  /  6i(a)  da  -  2  V'A*  /  Pi(r)?t(r)  dr, 

i= l  Jo  i= l  Jo 


where  P  >  0,  m  >  0  and  A;  >  0.  In  this  case,  condition  dV(x,t)/dt  <  0  is  equivalent  to  the  LMI 


AtP  +  PA 

BjP  -  (AC,  +  MCqA) 


PBp  -  (AC,  +  MCqA)T 
—(MCqBp  +  BjCjM) 


<  0 


(2.27) 


where  P  >  0,  M  =  diag(^i, . . . ,  fj,m)  >  0  and  A  =  diag(Ai, . . Am)  >  0.  If  condition  (2.27)  holds,  then 
the  ellipsoid 

S  =  {ip  G  R"  |  ^TP^  <  x(0)TPx(0) } 
is  an  invariant  ellipsoid  for  the  state  x. 

The  problem  of  finding  the  smallest  invariant  ellipsoid  (using  our  techniques),  i.e.,  one  with  the  smallest 
major  axis,  can  be  solved  by  solving  the  “eigenvalue  problem”  (see  Section  2.2.1) 


max 


v 


s.t.  P  >  i//,  *(0)TPx(0)  <  1,  (2.27), 

M  =  diag (/j, , . . . ,  fim)  >  0,  A  =  diag(Ai  , . . . ,  Am)  >  0 

With  Popt  denoting  the  optimal  P,  the  smallest  invariant  ellipsoid  that  contains  the  state  x(t)  for  all  t  >  0 
is 

{^Rn  |^TPoPt^<  1}. 

2.6  Conclusions 

We  have  provided  an  introduction  to  optimization  based  on  Linear  Matrix  Inequalities,  and  demonstrated 
its  application  in  robust  stability  and  performance  analysis  of  uncertain  systems. 
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Chapter  3 


Robustness  under  Bounded 
Uncertainty  with  Phase  Information 

We  consider  uncertain  linear  systems  where  the  uncertainties,  in  addition  to  being  bounded,  also  satisfy 
constraints  on  their  phase.  In  this  context,  we  define  the  “phase-sensitive  structured  singular  value” 
(PS-SSV)  of  a  matrix,  and  show  that  sufficient  (and  sometimes  necessary)  conditions  for  stability  of 
such  uncertain  linear  systems  can  be  rewritten  as  conditions  involving  PS-SSV.  We  then  derive  upper 
bounds  for  PS-SSV,  computable  via  convex  optimization.  We  extend  these  results  to  the  case  where  the 
uncertainties  are  structured  (diagonal  or  block-diagonal,  for  instance). 

3.1  Introduction 

Consider  the  model  of  a  control  system  with  uncertainty,  shown  in  Fig.  3.1.  Here  P(s)  is  the  transfer 
function  of  a  stable  linear  system,  and  A  is  a  stable  operator  that  represents  the  “uncertainties”  that  arise 
from  various  sources  such  as  modeling  errors,  neglected  or  unmodeled  dynamics  or  parameters,  etc.  As  we 
noted  in  Section  2.3,  such  control  system  models  have  found  wide  acceptance  in  robust  control. 


-1 


Figure  3.1:  Closed-loop  system 

It  is  often  the  case  that  the  uncertainty  A  is  linear,  time-invariant  (LTI),  and  diagonal.  In  this  case, 
unity-bounded  L2-gain  and  passivity  assumptions  on  A  can  be  interpreted  as  knowledge  on  the  frequency 
response  of  each  diagonal  entry  Su  of  A:  the  Nyquist  plot  of  6u  lies  inside  the  unit-disk  and  in  the  right-half 
complex  plane,  respectively.  There  are  instances  where  it  is  appropriate  to  model  Su  as  having  its  Nyquist 
plot  entirely  contained  within  some  acute  sector,  of  aperture  20  <  7r.  Such  a  sector  can  be  assumed,  without 
loss  of  generality  (via  simple  loop  transformation),  to  be  a  proper  subset  of  the  right-half  plane.  This  can 
occur  when  modeling  is  done  from  experimental  data  and  the  “Nyquist  cloud”  is  better  approximated  by  a 
sector  portion  of  a  disk  than  by  a  full  disk;  see  Example  3  in  §3.5.  It  can  also  occur  when  the  uncertainty, 
due  to  several  uncertain  parameters,  is  “lumped”  into  a  single  dynamic  uncertainty  block;  in  this  case,  the 
approach  presented  in  this  chapter  would  result  in  significant  computational  savings  in  comparison  with  the 

®  Joint  work  with  Professor  A.  L.  Tits,  University  of  Maryland,  and  Professor  L.  Lee,  National  Sun  Yat-Sen  Univ.,  Taiwan 
R.O.C. 
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direct  approach;  see  Example  2  in  §3.5.  In  both  instances  conservativeness  can  often  be  further  reduced 
by  allowing  for  frequency  dependent  sectors.  Investigation  of  robust  stability  under  such  “uncertainty  with 
phase  information”  is  another  objective  of  this  chapter. 

Uncertainty  is  often  best  represented  by  a  set  of  full  matrices  (or  block-diagonal  matrices),  and  handling 
this  situation  in  our  framework  necessitates  a  concept  of  “phase  of  a  matrix” .  Several  authors  have  proposed 
such  concepts.  In  [PEM81],  the  “principal  phases”  of  a  matrix  are  defined  as  the  arguments  of  the  eigenvalues 
of  the  unitary  part  of  its  polar  decomposition,  and  a  “small  phase  theorem”  is  derived  that  holds  under  rather 
stringent  conditions.  Hung  and  MacFarlane,  in  [HM82],  propose  a  “quasi- Nyquist  decomposition”  in  which 
the  phase  information  of  a  transfer  matrix  is  obtained  by  minimizing  a  measure  of  misalignment  between 
the  input  and  output  singular  vectors.  Finally,  Owens,  in  [Owe84],  uses  the  numerical  range  to  characterize 
phase  uncertainty  in  multivariable  systems.  The  concept  of  phase  we  adopt  here  is  related  to  that  of  [Owe84]. 
Our  definition  not  only  serves  to  characterize  phase  uncertainty  in  multivariable  systems,  but  also  provides 
a  practical  and  tractable  way  of  using  uncertainty  phase  information  in  robustness  analysis. 

Thus,  in  this  chapter,  we  consider  the  robust  stability  of  the  system  in  Fig.  3.1  when  A  is  a  block-diagonal 
LTI  uncertainty  that  simultaneously  satisfies  constraints  on  its  norm,  and  on  its  “phase”.  In  §3.2,  we  define 
the  phase-sensitive  structured  singular  value  (PS-SSV),  defining  in  the  process  the  phase  of  a  matrix.  We 
then  derive  a  condition  for  robust  stability  of  the  system  in  Fig.  3.1  in  terms  of  the  PS-SSV.  It  turns  out 
that  when  the  uncertainty  is  scalar,  or  made  of  diagonal  scalar  blocks,  the  PS-SSV-based  condition  on 
robust  stability  is  both  necessary  and  sufficient.  Computing  the  PS-SSV  exactly  turns  out  to  be  an  NP-hard 
problem.  We  therefore  concentrate  on  computing  an  upper  bound  on  the  PS-SSV,  in  §3.3.  In  §3.4,  we 
show  that  computation  of  this  upper  bound  can  be  reformulated  as  a  quasi-convex  optimization  problem; 
we  discuss  some  schemes  for  its  solution.  In  §3.5,  we  demonstrate  our  results  via  three  numerical  examples, 
and  we  conclude  with  §3.6.  Many  of  the  ideas  developed  in  this  chapter  were  adapted  from  earlier  work 
by  two  of  the  coauthors  and  M.  K.  H.  Fan,  see  [LTF89,  LT92b,  LT92a,  Lee92].  Results  closely  related  to 
those  of  §3.1  were  obtained  independently  by  Eszter  and  Hollot  [EH97]  for  the  case  when  the  phase  bounds 
amount  to  a  passivity  constraint  on  the  uncertainty. 

Notation.  R,  R+  and  Re  denote  the  sets  of  real  numbers,  nonnegative  real  numbers,  and  R  U  {oo}  (one  point- 
compactification  of  R),  respectively.  C,  C+  and  C+e  denote  the  set  of  complex  numbers,  complex  numbers 
with  positive  real  part  (i.e.,  the  open  right-half  complex  plane),  and  C+  U  {oo}  respectively.  Hoo  denotes 
the  set  of  scalar-  or  matrix-valued  functions  that  are  analytic  and  bounded  in  the  open  right  half  plane, 
and  RHoo  denotes  the  set  of  functions  in  Hoo  that  are  real  rational.  H *  denotes  the  complex-conjugate 
transpose  of  H  £  Cmxn.  For  H  £  Cnxn  satisfying  H  =  H* ,  the  notation  H  >  0  (H  >  0)  means  that  H  is 
positi ve-semidefinite  (positive-definite) . 

3.2  The  phase-sensitive  structured  singular  value 

3.2.1  Scalar  Case 

Let  us  first  consider  the  case  when  both  the  LTI  system  and  the  LTI  uncertainty  in  Fig.  3.1  have  a  single 
input  and  a  single  output.  Thus  P(s)  and  A(s)  are  scalar  transfer  functions,  and  to  emphasize  this,  we 
rename  them  as  p(s)  and  <5(s),  respectively. 

Let  <£:€—►  ( — 7r,  i r]  be  the  usual  phase  of  a  complex  scalar,  with  <^(0)  defined  to  be  0.  Note  that  |^(*)| 
is  lower  semicontinuous  (and  continuous  outside  every  neighborhood  of  the  origin).  Given  a  complex  scalar 
m  and  a  real  scalar  0  £  [0, 7 r],  let  pe{m)  he  defined  by 

Mm)  =  (inf  {|7l  =  I<Mt)I  <  0,  1  +  7^  =  0})-1 , 

if  the  set  over  which  the  infimum  is  taken  is  nonempty,  and  pe(m)  =  0  otherwise  (i.e.,  pe{m)  =  \m\  if 
\<j)(m)\  >7 r  -  0,  and  0  otherwise).  Note  that  pe(m)  is  upper  semicontinuous  in  ( 0 ,  m). 

Theorem  1  below  shows  that  various  properties  of  the  closed-loop  system  depicted  in  Fig.  3.1  can  be 
assessed  from  the  knowledge  of  (jlq  ( p(s ))  on  the  imaginary  axis,  under  various  assumptions  on  6. 

Theorem  1  Let  p  £  be  continuous  over  C+e,  let  0  :  Re  ~ ►  [0, 7 r],  and  let 

Aq  =  {6  £  Hqo  •  6  is  continuous  on  C+e,  ||6||oo  <  1>  |^(£(jw))l  <  0(w)  Vu;  £  Re}- 
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(3.1) 


Suppose  that 

(a)  sup^'He (u.)(p(jw))  <  1- 

Then  (1  +  bp )-1  G  Hm  for  all  b  G  Ag  and,  if  6  is  upper  semiconiinuous, 

sup  ||(1  +  <5p)_1||oo  <  °o. 

Moreover,  if  6  is  constant,  then  statements  (a),  (b)  and  (c)  are  equivalent,  where  (b)  and  (c)  are  as  follows: 

(b)  (1  +  bp)-1  G  Hoo  for  all  b  £  Ag  and  sup6eA$  ||(1  +  ^p)"1^  <  oo. 

(c)  (1  +  bp)-1  G  Hqo  for  all  b  £  RHoo  H  A g  and  supi€RHoonAe  ||(1  +  bp)  ^loo  <  <x>. 

Proof:  We  first  prove  by  contradiction  that  (a)  implies  that  (1  +  bp)-1  £  for  all  b  £  Ag.  Thus  suppose 

that,  for  some  b  £  Ag,  (1  +5p)_1  £  H«,.  It  follows  from  Cauchy’s  Principle  of  the  Argument,  using  a  simple 

homotopy  (see,  e.g.,  Lemma  1  in  [Tit95,  TB97]  for  details)  that  there  exists  a  £  (0, 1]  and  u>  G  Me  such  that 

1  +  o5(jw)p(jw)  =  0. 

Since  b  £  Ag,  it  is  clear  that  |«5(jw)|  <  1  and  |<£(or$(jw))|  <  9(w).  Thus  pg^)(p(. jw))  >  1,  a  contradiction. 
To  complete  the  proof  of  the  first  claim,  suppose  that  9  is  upper  semicontinuous  and,  proceeding  again  by 
contradiction,  suppose  that  (1  +  bp)-1  G  Hoo  for  all  b  G  Ag  but  that,  given  any  e  >  0  there  exist  be  £  A 
and  UjGl  such  that 

|l  +  <5£(jwe)p(ju>£)|  <  e. 

Let  7e  =  <5e(jwe)  and  note  that,  since  bc  £  A, 


\<t>{le)\  <  0(<*>£). 

Since  \~ft  \  <  1  it  follows  from  compactness  of  the  complex  unit  disk,  continuity  of  p  on  jffie,  lower  semicontinu¬ 
ity  of  \<j>\  and  upper  semicontinuity  of  6  that  there  exits  7  G  C+e  and  w  G  Me  such  that  I7I  <  1,  |<^(t)I  0(^0 

and  1  +7p(jw)  =  0.  Thus  pe(<i)(p(jw))  >  1,  a  contradiction.  To  complete  the  proof  of  the  theorem,  first  note 
that  the  implication  (b)=>(c)  holds  trivially.  Suppose  now  that  9  is  constant.  The  implication  (a)=>(b)  has 
just  been  proven.  It  thus  remains  remains  to  show  that  (c)=>(a).  We  again  use  contradiction.  Thus  assume 
that 

sup  pe(p(jw))  >  1. 

We  show  that,  given  any  e  >  0,  there  exists  6  E  A#  fl  RHoo  and  &  £  Re  such  that  |1  4  £(j£)p(j^)|  <  e, 
a  contradiction.  Let  u  E  Me  be  such  that  pe(p{ jw))  >  1  (since  p  is  continuous  on  jMe  and  pe(-)  is  upper 
semicontinuous,  such  u>  always  exists).  Thus,  for  some  7  E  C+ ,  with  \j\  <  1  and  \<f>(y)\  <9,1  4  7P(j^)  =  0. 
Note  that,  if  9  =  0,  the  claim  holds  trivially  (take  S(s)  =  7  for  all  s);  thus  assume  that  0  >  0.  Since  p  is 
continuous  on  jRe?  there  exist  u)  E  M  \  {0}  and  7  G  {7  G  C+  :  I7I  <  1>  \$(l)\  <  0}  such  that  |1  4  7P(J^)I  <  €- 
It  is  shown  in  Appendix  A  that,  under  these  conditions,  there  exists  6  E  A#  fl  RHqo  such  that  6(ja))  =  7. 
This  completes  the  contradiction  argument.  D 

Remark  3.2.1  The  upper  semicontinuity  assumption  on  9  is  indeed  needed  in  order  for  (3.1)  (uniform 
robust  stability)  to  follow,  as  shown  by  the  following  example.  Let  p(s)  =  2(s  4  1  )/(s  4  2).  Let  u  be  the 
frequency  at  which  the  phase  of  p(ju>)  is  largest  (in  the  first  quadrant)  and  let  be  its  value.  Define  6  by 
9(w)  =  7t/2  and  9(w)  =  7r  —  $  for  all  other  u>.  It  is  readily  checked  that  pe(u)(p(&))  “  0  for  all  w  but  that 
1  4  p(ja;)<5(ju>)  can  be  made  arbitrarily  close  to  0  in  the  neighborhood  of  Q. 

Remark  3.2.2  The  sufficiency  part  of  Theorem  1  can  be  extended  to  handle  more  general  uncertainty  sets. 
See  remark  immediately  following  Theorem  3. 

We  leave  open  the  question  of  necessity  of  condition  (a)  of  Theorem  1  under  relaxed  assumptions  on  9. 
It  may  be  necessary,  e.g.,  to  require  that  9(u>)  not  approach  zero  too  fast. 
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3.2.2  The  matrix  case  with  structure 

Phase  and  phase-sensitive  structured  singular  value 

As  a  first  step  toward  extending  the  results  of  §3.2.1  to  matrix- valued  P  and  A,  we  propose  a  concept  of 
phase  of  a  matrix. 

Given  a  complex  matrix  T,  let  A f(T)  be  its  numerical  range,  i.e., 

Af(T)  =  {x*Tx  :  xedB}  C  C 

where  dB  =  {x  6  C”  :  ||x||2  =  1}  and  ||  *  ||2  is  the  Euclidean  norm.  This  set  is  known  to  be  convex.  The 
following  definition  is  a  slight  modification  of  that  used  in  [Lee92]. 

Definition  1  Let  T  ^  0  be  a  complex  square  matrix  such  that  0  £  intAT(r).  The  median  phase  MP(r)  ofT 
is  the  angle,  with  a  range  of  (— 7r,  7t],  between  the  positive  real  axis  and  the  ray  bisecting  the  smallest  sector 
containing  Af(T).  The  phase  spread  PS(T)  of  T  is  half  the  angle  of  this  sector  (see  Fig .  3.2).  We  define 
MP(0)  and  PS(0)  to  be  0. 


Figure  3.2:  Numerical  range,  median  phase  and  phase  spread. 

Thus  MP(r)  G  ( — 7r,  7r]  and  PS(r)  G  [0, 7r/2].  Below  we  will  refer  to  the  pair  (MP(F),  PS(r))  as  phase 
information  of  T.  If  0  G  intAf(T),  there  is  no  phase  information  for  F. 

Note  that  in  the  case  of  a  complex  number  a  =  pe^  with  p  >  0  and  <fi  G  (— 7r,  tt],  the  phase  information 
of  a  is  (</>,0).  Also,  the  phase  information  of  a  matrix  is  invariant  under  multiplication  of  the  matrix  by  a 
positive  number,  and  if  T  is  Hermitian  positive  semidefinite,  its  phase  information  is  (0,  0).  Finally,  the  phase 
information  of  a  matrix  is  invariant  under  unitary  similarity  transformations  (since  the  numerical  range  is). 

Median  phase  and  phase  spread  are  related  to  the  concept  of  principal  phases  introduced  by  Postlethwaite 
et  al.  in  [PEM81].  Namely,  for  any  square  complex  matrix  T, 

MP(F)  -  PS(r)  <  ^min(r)  <  i/w(r)  <  MP(r)  +  PS(r) 

where  ^ min(r)  and  V’max(r)  are  the  minimum  and  maximum  principal  phases  of  T,  respectively.  This  result, 
stated  differently,  was  obtained  by  Owens  [Owe84]  (who  also  used  the  term  “phase  spread”). 

For  any  matrix  T  with  0  ^  intA/*(r),  Af  G  C+.  In  other  words,  we  can  rotate  the  numerical 

range  of  any  matrix  T  for  which  0  ^  intAf(r)  so  that  it  is  contained  in  the  right-half  complex  plane.  With  this 
in  mind,  we  restrict  our  attention  in  the  sequel  to  matrices  T  with  F  +  V*  >0  (or  equivalently  Af(T)  C  C+). 
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For  such  matrices,  we  next  give  alternate  characterizations  of  the  phase  information;  these  will  serve  us  well 
in  our  derivation  of  stability  tests  in  the  sequel. 

Given  T  with  T  +  T*  >  0,  of  particular  interest  is  the  smallest  sector  (i.e,  one  that  subtends  the  smallest 
angle  at  the  origin)  in  the  right-half  plane,  symmetric  about  the  real  axis,  that  contains  (The  interest 

stems  from  the  fact  that  in  the  sequel,  we  will  consider  uncertainties  A  whose  numerical  range  is  known  to 
lie  in  such  symmetric  sectors  at  every  frequency.)  Let  2$(r)  be  the  angle  subtended  by  this  sector  at  the 
origin.  Evidently  (see  Fig.  3.2), 

*(r)  =  max  {MP(r)  +  ps(r), -(MP(r)  -  ps(r))} .  (3.2) 

We  then  have  the  following  alternate  characterization  for  3>(T). 

Lemma  3.2.1  Let  T  6  Crixn,  with  r  +  T*  >0.  Then , 

<F(T)  =  cot-1  ^sup  :  r  +  r*  -  j(r  —  F*)  >  0  V/?  E  {—6,  b} .  (3.3) 

Proof:  From  Fig.  3.2  it  is  clear  that,  for  b  >  cot($(r))  (i.e.,  6  ^  0  and  6”1  <  tan($(r))),  there  exists  veC1 
such  that 

Re(vTv)  <  6|Im(i)*ri5)| 

i.e.,  for  some  fi  E  {—&,  &}, 

r  +  r*  -  j(r-r*)  ^  o. 

Moreover,  with  b  =  cot($(r))  G  (-00, 00),  it  is  clear  from  the  figure  that,  for  all  v  G  C” , 

Re(u*rv)  >  /?|Im(u*rv)|  V/?  G  {-b,  b} 

i.e., 

r  +  r*  -  ?(r  -  r*)  >  o  v/?  g  {— fr,6}. 
j 

Finally,  if  $(r)  =  0  then  W(r)  is  a  subset  of  the  negative  imaginary  axis,  i.e.,  r  =  T*  >  0,  and  thus  the 
matrix  inequality  in  (3.3)  holds  for  every  finite  /?.  1:1 

Remark  3.2.3  It  is  easy  to  verify  that  for  any  T  satisfying  T  +  T*  >  0  with  ^(r)  >  0,  we  have 
r  +  r*  -  ?(r-  r*)  >  o  for  ail  p  e  [-cot$(r),cot$(r)]. 

Lemma  3.2.2  <3>  is  lower  semicontinuous  over  {T  :  T  +  T*  >  0}. 

Proof:  Let  0  G  [0,  tt/2]  and  let  {T*}  -+  f ,  with  rfc  +  TJ  >  0  for  all  k,  and  lim  sup  $(rfc)  <  0.  We  show 
that  $(f )  <  0,  proving  the  claim.  If  0  =  tt/2  the  result  is  obvious.  Thus  suppose  9  G  [0,  tt/2)  and  let 
e  e  (0,  tt/2  -  0}.  For  k  large  enough,  $(rfc)  <  9  +  e,  and  thus,  taking  the  cotangent  of  both  side  of  (3.3) 
(*  +  €  >  0),  for  k  large  enough, 

rk  +  r*k-  y(r*  -  rj)  >  o  v/?  g  [-  cot (0  +  e),  cot(0  +  e)]. 

It  follows  that 

f  +  f  *  -  y(f  -  f*)  >  0  V/3  G  [—  cot(0  +  e),  cot(0  +  e)], 

i.e.,  (again  using  (3.3)),  that  cot($(f))  >  cot(0  +  e),  i.e.,  $(f)  <  0  +  e.  Since  this  holds  for  arbitrarily  small 

e  >  0,  the  claim  follows.  a 

With  an  eye  towards  issues  of  robust  stability  with  respect  to  possibly  block-structured  uncertainty,  we 
now  extend  the  definition  of  /i#  to  handle  block-diagonal  structures.  Given  positive  integers  ki,  i= 
such  that  ^,ki  =  n,  we  define  the  set  of  block-diagonal  matrices  with  block  sizes  ki  as 

r  =  {diag(r1,...,r<):r,GC*iXfc-}.  (3.4) 
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(3.5) 


We  next  define  T©  as  the  following  phase-constrained  subset  of  T : 

r©  =  {diag(ri, . . . , r<) :  r\-  g  $(r.)  <e{}, 

where  0  =  (#i, . . .  ,0/)  with,  for  i  =  1, . . .  0*  6  [0,7t/2].  Note  that  T  +  T*  >  0  for  all  T  E  T©. 

Definition  2  The  phase- sensitive  structured  singular  value  of  M  E  Cnxn  ithfA  respect  to  T©  is  by 

fire(M)  =  (inf{^(r)  :  T  G  re,  det(J  +  TM)  =  0})_1 
i/det(J  -j-  TM)  =  0  /or  some  T  E  T©,  and  pr&(M)  =  0  otherwise . 

Properties  of  //re 

Unlike  the  “standard”  mixed  //,  /iFe  is  clearly  not  invariant  under  change  of  sign  of  its  argument.  Thus,  in 
particular,  it  is  not  always  larger  than  the  spectral  radius  p  (complex  p)  or  the  real  spectral  radius  p&.  On 
the  other  hand  it  is  clear  that 

Pv_(M)  <  Hre(M)  <  »(M),  (3.6) 

where,  for  any  complex  matrix  M, 

=  max{A  :  —A  is  a  negative,  real  eigenvalue  of  M}, 

with  pffi_(M)  =  0ifM  has  no  negative,  real  eigenvalues.  This  leads  to  the  following  easily  derived  charac¬ 
terization  of  pr&.  (Note  that  p&_  is  upper  semicontinuous,  which  justifies  the  “max”.) 

Theorem  2 

pr  ( M )  —  max  a*  (TM)  =  max  p a  (Mr).  (3.7) 

rre\  )  rere>  a(r)<i  ~v  }  rer&fo(r)<i 

Like  the  standard  mixed  //,  pr&  is  invariant  under  similarity  scaling  of  its  argument  by  matrices  that  com¬ 
mute  with  the  elements  of  the  uncertainty  set,  i.e.,  given  any  nonsingular  matrix  D  =  diag(d1/fc1, . .  .,d^/^), 

»re(M)  =  vrjDMD-1). 

In  general  however,  pr&  is  clearly  not  invariant  under  pre-  or  post-multiplication  of  its  argument  by  a  unitary 
matrix  in  T© . 

Next,  it  is  readily  verified  that  pr&  (M)  is  monotonic  nondecreasing  in  each  of  the  components  of  0  and, 
using  lower  semicontinuity  of  <3>  (Lemma  3.2.2),  that  pr&{M)  is  upper  semicontinuous  in  (0,  M).  Finally, 
the  following  result  holds. 

Proposition  1  Let  P  E  Hoo  be  continuous  over  C+e,  and  let  0  E  [0,7t/2]C  Then 

sup  Pre(P(jw))  =  sup  Pre(P(s)). 

56 C+e 


Proof:  We  show  that  the  following  statements  are  equivalent: 

(a) 

sup  PrJP{ jw))  <  1, 

co  6®  «. 

(b) 

(i  +  tp)-1  gHoo  vrGr©,F(r)<  i, 


(c) 


SUP  Pr6(P(s))  <  i- 

5  6C+e 


Since  ptQ  is  positive  homogeneous,  the  claim  then  follows  from  the  equivalence  of  (a)  and  (c).  We  first  show 

by  contradiction  that  (a)=^(b).  Thus  let  f  E  T©,  with  <f(f)  <  1,  be  such  that  (/  +  fP)-1  ^  Hoq.  As  in 
the  proof  of  Theorem  1,  it  follows  from  Cauchy’s  Principle  of  the  Argument  that  there  exist  a  E  (0,1]  and 
Cj  E  Me  such  that 


det(/  +  arP(jw))  =  0. 


Since  at  E  T©  and  cr(af)  <  1,  this  implies  that  pr^(PQLo))  >  1,  a  contradiction.  Concerning  the  implication 


(b)=^(c),  if  there  exists  s  E  C+e  be  such  that  pVe(P(s))  >  1,  then  there  exists  f  E  T©,  with  cr(f)  <  1,  such 
that  det (/  +  t  P(s))  —  0,  contradicting  (b).  Finally,  the  implication  (c)=>(a)  holds  trivially.  □ 
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The  small-//re  theorem 

Given  any  0  :  Me  — ►  [0, 7t/2]*,  we  define 

A©  =  {Ag  Hqo  :  A  is  continuous  on  C+e>  ||A||oo  <  1,  A(ju>)  E  r©(w)  Vo;  E  Me}. 

Theorem  3  Let  P  E  Hoo  continuous  over  C+e,  lot  0  :  Me  — ►  [0,7t/2]^.  Suppose  that 

(a)  supw€ffitpreM(P(jw))  <  1. 

Then  (I  +  AP)_1  G  Hqo  /or  all  A  G  A©,  and  ifQ  is  upper  semicontinuous,  then 

sup  ||(7  +  AP)-1||oo  <  oo. 

<56  Ae 

Moreover ,  ifQ  is  constant,  then  (a)  is  equivalent  to 

( b )  (I  +  A P)_1  E  Hoo  for  all  A  E  A©  and  sup^Ae  || (I  +  AP)_1||oo  <  oo. 

Proof:  The  implication  (a)=>(b)  is  proved  as  in  Theorem  1  with  det (I  +  A P)  replacing  1  +  6p.  Concerning 
the  implication  (b)=>(a),  note  that,  if  6  is  constant  and  (a)  does  not  hold,  then  (since  P  is  continuous  over 
C+e  and  pr&  is  upper  semicontinuous)  there  exists,  among  others,  a  constant  (complex)  A  E  A©  and  some 
d >  E  Me  such  that  det (7  +  AP(jd>))  =  0,  contradicting  (b).  □ 

Remark  3.2.4  Again,  the  sufficiency  part  of  Theorem  3  can  be  extended  to  handle  more  general  uncertainty 
sets.  For  example,  consider  the  uncertainty  set 

A©  =  {Ae  Hqo  •  A  is  continuous  on  C+e,  U{u) A(ju>)  E  T©(w),  <f(A*(ju;))  <  di(u ),  i  =  Vu>  E  Me}, 

where  di  :  Me  -*  [0,oo),  i  =  1  0  :  Me  — »*  [0}ir/2]1,  and  U(u)  =  diag^^a;)/^, , . . . ,  ut(u))ht),  with 

U{  :  Me  — ►  {z  E  C  :  \z\  =  1}.  Then,  it  is  easy  to  show  that  if 

SUP  ^re(  .(diaS (di(w)Iki)U(u>)* PQu))  <  1, 
e(“) 

then,  (1  +  AP)-1  E  Hoo  for  all  A  E  A©;  an7  that  if,  in  addition,  di  and  0  are  upper  semicontinuous,  and 
U  is  continuous,  then 

sup  ||(1  +  AP)“"1||  <  oo. 
agA© 

Again  we  will  leave  open  the  question  of  necessity  of  condition  (a)  of  Theorem  3  under  relaxed  assumptions 
on  0.  On  the  other  hand,  even  for  constant  0,  it  is  unclear  in  general  whether,  if  (a)  does  not  hold,  there 

exists  A  E  A©  real  on  the  real  axis  (which  must  be  the  case  if  A  is  the  transfer  function  of  a  real  impulse 

response)  such  that  (7-f  AP)”1  £  Hoo  or  \\(I  +  AP)_1||oo  is  arbitrarily  large.  In  the  case  of  purely  diagonal 
uncertainty  structures,  though,  this  is  the  case  even  with  the  additional  requirement  that  A  be  rational.  In 
other  words  the  following  holds. 

Theorem  4  Let  P  E  Hqo  be  continuous  over  C+e?  lot  ©  E  [0, 7r/2]^,  and  suppose  k{  =  1,  i  =  1, . .  .,i  (=  n), 
i.e.,  suppose  that  T©  consists  of  diagonal  matrices.  The  following  statements  are  equivalent. 

(a)  supa,gjRs/ire(P(ju;))  <  1. 

(b)  (I  +  AP)-1  G  Hqo  for  all  A  G  A©  and  supAeAe  ||(7  +  AP)-1||oo  <  oo. 

(c)  (7  +  AP)-1  G  Hoo  for  all  A  G  RHoo  n  A©  and  supA€RHoonAe  IK7  +  AP)-1!^  <  oo. 

(The  proof  of  the  implication  (c)=>(a)  is  exactly  along  the  lines  of  that  of  the  corresponding  implication  in 
Theorem  1.) 

3.3  Upper  Bounds  on  /iTq 

So  far,  we  have  seen  definitions  of  fir&,  and  how  conditions  on  fir&  give  sufficient  (and  sometimes  neces¬ 
sary)  conditions  for  uniform  robust  stability.  In  this  section,  we  will  concern  ourselves  with  the  numerical 
computation  of  fiVe . 

Computing  fir  exactly  is  equivalent  to  finding  the  global  minimum  of  a  nonconvex  optimization  problem, 
and  we  are  not  aware  of  any  efficient  solution  methods  for  it.  Therefore,  we  will  not  attempt  to  compute 
/xre  directly;  instead,  we  will  derive  numerically  computable  upper  bounds  on  which  will  give,  in  turn, 
sufficient  conditions  for  robust  stability. 
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3.3.1  The  matrix  case  with  structure 


Computing  /Ve(m)  for  a  scalar  m  is  trivial.  We  then  consider  the  problem  of  computing  an  upper  bound 
on  /zre(M),  when  M  is  a  matrix,  and  T  is  assumed  to  have  some  structure,  that  is,  it  is  required  to  belong 
to  the  set  T© .  Let 

{5  :  S  =  {diag(«iJi1( . .  .,stIkl) :  s«  >  0}  , 
and,  given  @  =  (ft , . . . ,  ft)  with  ft  G  [0, 7r/2] ,  i  =  let 

n  a  f  B  =  diag(/?i ft  I**),  ft  GM,i=  1, \ 

0  (  '  with  ft  G  [—  cot  ft ,  cot  ft]  when  ft  >  0  J  ' 

We  then  have  the  following  lemmas. 


Lemma  3.3.1  Lei  T  G  T©,  with  r*T  <  I.  Then,  T  satisfies,  for  every  R,  S  G  S,  and  B  G  B&, 


I 

r 


S(I+jB) 


(I-jB)S 

-R 


>  0. 


Proof:  Consider  any  T  G  T©  satisfying  TT  <  I.  Since  I'  commutes  with  every  R  G  R,  we  have 


R-T*RT>0. 


(3.8) 


(3.9) 


Next,  since  F  E  T©,  in  view  of  Lemma  3.2.1  and  of  the  remark  following  it,  and  since  —B  £  Be  whenever 
B  £  Bq,  we  have  for  every  B  £  Be , 


r  +  r-j(5r-r*5)>o. 

Since  T,  every  S  £lZ  and  every  B  £  B  commute  with  each  other,  we  then  have 

^r  +  rs-j^r-rs'B)  >o.  (3.10) 

From  (3.9)  and  (3.10),  we  conclude  that  every  T  £  T©  with  r*r  <  I  satisfies,  for  every  R,  S  £  S  and 
B£Bq, 

R-T*RF+(I -}B)SF  -F  F* 5(7+  ]B)  >  0, 

which  is  equivalent  to  (3.8).  □ 

Theorem  5  Let  T  £  T©,  with  F*F  <  I.  If  there  exists  some  R£  S}  S  £  S,  and  B  £  Bq}  such  that 

M*RM-~R~(S(I+)B)M  +  M*(I-jB)S)  <  0,  (3.11) 


then  det(J  -f  FM)  0. 

Remark  3.3.1  Theorem  5  constitutes  a  special  case  of  the  general  stability  theorem  for  systems  with  uncer¬ 
tainties  described  by  integral  quadratic  constraints  or  IQCs  [MR97,  Theorem  1].  In  particular ,  Theorem  5 
can  be  viewed  as  a  sufficient  condition  for  the  well-posedness  of  a  feedback  interconnection  of  a  constant  ma¬ 
trix  with  a  constant  phase-  and  norm-bounded  uncertainty  in  the  feedback  loop .  Since  there  are  no  dynamics 
involved ,  a  direct  linear  algebraic  proof  can  be  given,  which  we  present  next  for  the  sake  of  completeness. 

Proof:  Rewriting  (3.11)  as 


’  —M  ' 

* 

R 

(I-jB)S  ‘ 

'  -M  ‘ 

I 

.  S(I+jB) 

-R 

I 

(3.12) 


we  now  proceed  by  contradiction.  Suppose  that  det(7  -f  FM)  —  0.  Then  for  some  nonzero  v  £  V1 ,  we  have 
(I  -b  FM) v  —  0.  Defining  u  —  Mv,  we  have  v  =  —F u.  Now,  from  (3.12),  we  have 


'  -M  ' 

* 

R 

C I-jB)S  ' 

'  -M  ' 

I 

.  S(I+jB ) 

-R 

I 
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The  conclusion  of  Corollary  1  represents  one  of  the  central  contributions  of  the  chapter — we  now  have 
an  upper  bound  for  fir&,  which,  as  we  shall  see  in  §3.4,  can  be  numerically  computed  quite  efficiently,  using 
convex  optimization  techniques. 

Remark  3.3.2  It  is  easily  shown  that}  for  any  scalar  m,  fire(m)  = 

3.3.2  An  off-axis  circle-criterion  interpretation 

As  was  done  in  [Doy85]  and  in  §V  of  [FTD91]  in  the  context  of  the  “classical”  mixed  /i,  it  is  possible  to 
obtain  the  phase-sensitive  fi  upper  bound  by  optimizing  the  complex  //  upper  bound  over  a  set  of  disk 
uncertainties.  Consider  a  “block-diagonal  disk  uncertainty  set”,  i.e.,  a  set  of  block  diagonal  matrices  such 
that  each  block  ranges  over  a  certain  “hyperdisk”,  namely  over  the  image  of  {I\  :  <  1}  under  a  certain 

linear  fractional  transformation.  A  “complex-//’  type  upper  bound  is  readily  obtained  corresponding  to  such 
uncertainty  blocks.  Clearly,  if  the  uncertainty  set  covers  {F  E  T©  :  a(F)  <  1},  then  this  upper  bound  is 
also  an  upper  bound  for  fir& .  Below  we  show  that  minimizing  this  bound  over  a  certain  family  of  such 
transformations  yields  precisely  the  bound  given  by  Theorem  5  and  Corollary  L 
Given  S  E  S  and  B  £  Be,  let 

a\  F(I  +  F*F)~1'2  /' 

[  ( I  +  F*F)~ l'2  0  J  ’ 

where  F  =  5(7  +  j  7? ) .  It  is  readily  checked  that  the  “lower”  linear  fractional  transformation  Fi(T,—M)  is 
well  defined  for  any  M,  that  the  “upper”  linear  fractional  transformation  FU(T,  T)  is  well  defined  whenever 
<f(r)  <  1,  and  that  (provided  <r(r)  <  1) 

F,{T, - M )  =  (F  -  M)(I  +  F*F)~1/2, 

FU(T,  T)  =  ((/  +  F*  F)1/2  -  TF )-1r. 
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□  ttj 


Figure  3.3:  Three  “equivalent”  block  diagrams. 


Consequently,  the  systems  in  the  three  block  diagrams  of  Fig.  3.3  are  all  equivalent  in  the  sense  that  each 
one  is  well-posed  if  and  only  if  the  other  two  are. 

For  the  sake  of  geometric  intuition  consider  now  the  case  of  a  diagonal  (rather  than  block  diagonal) 
structure,  say,  F  ~  diag(/t),  with  fc  =  sx(  1  +  j /?,),  Si  >  0  and  |/?*|  <  cot0j  when  0,-  >  0.  Let  B T  be  the  set 
of  complex  diagonal  matrices  T  with  <f(r)  <  1.  The  image  of  Br  under  the  linear  fractional  transformation 
FU(T,  •)  is  given  by 

FU(T,BT)  =  jdiag  ((7-Vl  +  l/il2-  /s)_1)  :  ItI  <  l}  • 

It  is  straightforward  to  check  that  each  diagonal  entry  ranges  over  a  circle  of  radius  y/l  +  \  fi\2  =  \J  1  +  sf{  1  +  fif) 
centered  at  fi  —  sx(l  —  j  /%)  (see  Fig.  3.4).  It  follows  that,  for  each  sx  >  0  and  each  /?*  with  |/?x|  <  cot  0X  when 

0i  >  0, 

{r  g  r0  :  w( r)  <  1}  c  fu(t,  bt),  (3.14) 

which  shows  that  each  diagonal  “disk”  entry  of  FU(T ,  BT)  “covers”  the  corresponding  entry  in  the  uncertainty 
set  of  interest,  {T  E  r<~>  :  ^(r)  <  1}.  Conversely,  it  is  easy  to  show  that  any  disk  that  covers  a  diagonal 
entry  in  the  uncertainty  set  {r  E  T©  :  <r(r)  <  1}  must  be  the  corresponding  diagonal  entry  of  FU(T ,  B T)  for 
some  T:  it  is  easy  to  solve  “backwards”  for  sx  and  /%,  given  the  center  and  radius  of  the  disk. 

The  same  inclusion  (3.14)  holds  in  the  general  (block  diagonal)  case.  Indeed 


T-i  _ 


0 

I 


(/  +  F*  F)1/2 
-F 


and  simple  algebra  shows  that,  for  any  T  with  (j(r)  <  1,  F\(T  T)  is  well  defined  and 

fu(t,f,(t-\ r))  =  r, 


and  thus  it  is  enough  to  show  that 


F,(T-\  {r  E  T©  :  W{T)  <  1})  C  BF. 

To  see  that  the  latter  inclusion  holds,  assume  without  loss  of  generality  that  £  =  1  (full  matrix  uncertainty), 
i.e.,  F  —  fi ,  with  /  =  s(  1  -f  j /?),  s  >  0,  \/3\  <  cot  0  when  6  >  0,  and  let  V  E  T©  with  a(r)  <  1.  It  remains  to 
show  that 

a(F,(T-\T))<  1, 

or,  equivalently, 

/-(i  +  l/l2)U  +  /r*)-1r*r(/  +  /r)-1  >0, 

i.e.,  via  a  congruence  transformation, 

(i  +  fr*)(i  +  /r)  -  (1  +  |/|2)r  r  >  o, 


^his  result  was  first  reported,  in  a  slightly  different  form,  in  [LTF89].  For  the  case  when  6{  =  7r/2,  i  =  1,..  (passive 
uncertainty),  it  is  a  special  case  of  a  result  obtained  independently  by  Eszter  and  Hollot  [EH97]. 
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i.e. 


(j-r*r)  +  (/r  +  /p)  >  o. 

Since  this  clearly  holds  for  any  T  G  T©  with  ^(r)  <  1,  (3.14)  holds  in  the  general  case  as  claimed. 
A  sufficient  condition  for 

det(/  +  rM)  #0  vr  G  r©,  a(r)  <  1, 

i.e.,  for  /. ir  (M )  <  1,  is  thus  that 

det(7  +  TM)  ^  0  Vr  G  FU(T, Br). 

Since  the  second  and  third  block  diagrams  in  Fig.  3.3  are  equivalent,  the  latter  holds  if  and  only  if 

det(7  -  Fi(T,  —M)T)  ^  0  Vr  G  Br, 

fi(F,(T,-M))<  1, 

and  a  sufficient  condition  for  this  is  that,  for  some  R  G  <S, 

a(RF,(T,-M)R~1)  <  1. 

Since  S  and  B  commute,  letting  Mr  =  RMR -1,  we  get 

RF,(T,  —M)R~l  =  {F  —  Mr){I  +  F*F)~1^2. 

It  follows  that  (3.15)  holds  if,  and  only  if 

((F  -  Mr){I  +  F*F)~1'2Y((F  -  Mr)(I  +  F*F)~1/2)  <  7, 

i.e.,  if,  and  only  if, 

(F*  -  M*r){F  -  Mr)  <  I  +  F*F, 

which  holds  if,  and  only  if, 

MrMr  -  /  -  F*Mr  -  M*rF  <  0, 
which  is  equivalent  to  the  condition  given  in  Theorem  5. 


(3.15) 


3,3.3  Some  special  cases 

It  is  instructive  to  study  the  application  of  Theorem  5  and  Corollary  1  to  some  special  cases  for  the  set  T©. 
These  cases  are  encountered  more  often  in  practice;  also,  for  some  of  these  special  cases,  we  can  relate  our 
results  to  those  from  literature. 


Bounded  passive  uncertainty 


We  consider  first  the  case  when  the  T©  consists  of  unstructured  or  full  matrices  (i.e.,  i  -  1)  with  a  known 
bound  on  their  maximum  singular  value,  and  whose  phase  is  known  to  be  7r/2  or  less.  This  situation  arises 
when  the  uncertainty  A  is  passive  and  bounded.  If  A  were  scalar  (i.e.,  k\  =  1),  this  would  mean  that  the 
Nyquist  plot  of  A  is  in  a  semicircle  of  known  radius  that  lies  in  the  right-half  complex  plane,  shown  in  in 
Fig.  5(a). 

In  this  case,  Be  =  {0}  and  S  consists  of  positive  multiples  of  the  identity  matrix.  Therefore,  from 
Corollary  1,  we  have 


/Ve(M)  =  inf 


rM* M  —  72r7  —  s  (M  +  M*)  <  0 
7>0,  r>0,  s>0 


which  further  simplifies  to 

fire (M)  —  (max  {0,  inf  {Amax  (M*M  -  c  (M  +  M*))  :  c>0}})1/2, 
where  Amax  denotes  the  largest  eigenvalue  of  the  corresponding  Hermitian  matrix. 
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(1) :  ft  =  -  cot  (ft)  (l),(2):  ft  =  -  cot(ft) 

(2) :  -  cot  (ft)  <  ft  <  0  (4),  (5):  ft  =  cot(ft) 

(3) :  ft  =  0  *  (1),(5):  *  =  1 

(4) :  0  <  ft  <  cot(ft)  (2)j(4):  0  <  <  1 

(5) :  ft  =  cot(ft)  (3):  Si  =  0 

Figure  3.4:  Covering  the  uncertainty  with  off-axis  circles.  The  figure  on  the  left  shows  the  covering  of  the 
ith  diagonal  phase-bounded  uncertainty  with  disk-uncertainties  obtained  by  loop  transforming  the  unit-disk 
with  /,•  =  (1+j Pi)  for  various  values  of  /%.  The  figure  on  the  right  shows  the  covering  with  disk-uncertainties 
obtained  by  loop  transforming  the  unit-disk  with  /,*  =  ft  (1  ±  j  cot  ft)  for  various  values  of  ft. 


Bounded,  constant,  Hermitian,  positive-definite  uncertainty 

We  next  consider  the  case  when  A  is  a  constant,  Hermitian,  positive-definite  matrix,  with  a  known  bound  on 
its  maximum  singular  value.  If  the  uncertainty  were  scalar  (i.e.,  k\  =  1),  this  would  mean  that  the  Nyquist 
plot  of  the  uncertainty  is  simply  a  point  in  a  sub-interval  of  the  positive  real  axis,  as  shown  in  Fig.  5(b). 

In  this  case  the  set  Be  consists  of  arbitrary  real  multiples  of  the  identity,  while  S  consists  of  positive 
multiples  of  the  identity.  Therefore,  we  have, 


A  re(M)  =  inf 


rM* M  -  y2rl  -  s(l  +  jb)M  -  M*(l  -  jb)s  <  0 
7>0,  r>0,  s  >  0,  6gM 


which  further  simplifies  to 

fire(M)  =  (max  {0,  inf  {Amax  (M*M  —  (c  +  jd)M  —  M*{c  —  jrf))  :  c  >  0,  d  €  M}})1/2 . 

It  is  instructive  to  consider  other  special  cases  of  the  instances  considered  above,  when  the  uncertainty 
is  diagonal ,  so  that  &!  =  •••  =  &/=!. 


Diagonal  bounded  passive  uncertainty 

Suppose  that  the  Nyquist  plot  of  each  of  the  diagonal  uncertainties  is  known  to  lie  a  half-disk  such  as  the 
one  shown  in  Fig.  5(a).  In  other  words  the  uncertainty  is  diagonal,  passive  and  bounded.  In  this  case,  the 
set  Be  —  {0}  and  the  set  S  consists  of  diagonal  positive-definite  matrices.  Here 

~  r  f  M*RM-72R-SM -M*S  <0  \ 

)  —  in  ^  >  o,  5  >  0  and  diagonal  J  * 
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(a)  Bounded  passive  uncertainty: 

The  Nyquist  plot  is  known  to  lie  in  the 
shaded  region. 


(b)  Positive,  real  uncertainty:  The 
Nyquist  plot  is  known  to  he  in  a  sub¬ 
interval  of  the  positive  real  axis. 


Figure  3.5:  Various  special  cases 


Diagonal,  bounded,  positive,  constant  real  uncertainty 

Finally,  we  consider  the  case  when  each  of  the  diagonal  uncertainties  is  a  constant  unknown  parameter, 
known  only  to  lie  in  some  sub-interval  of  the  positive  real  axis  such  as  the  one  shown  in  Fig.  5(b).  Such 
uncertainties  are  often  called  parametric  uncertainties.  Here,  the  set  B&  consists  of  arbitrary  real  diagonal 
matrices,  while  S  consists  of  diagonal  positive-definite  matrices.  Thus, 


,  (M)  =  infL.  M*  RM  —  y2  R  —  S(I  +  ]B)M  —  M*(I  —  jB)S  <  0  1 

’  7  >  0,  iZ,  5,  B  real  and  diagonal,  R  >  0,  S  >  0  / 


(3.16) 


Remark  3.3.3  This  case  of  bounded  diagonal  real  uncertainty  is  well-studied  in  the  literature,  usually  under 
the  name  of  “real-pi”  analysis;  see  for  example ,  [FTD91,  Bal95].  The  problem  considered  in  these  references 
is  the  computation  of  fim(M),  which  is  defined  as 


m(M)  = 


inf  <  a(T)  :  T  is  diagonal  and  real, 
K  [  det(I  -f  TM)  =  0 


if  det( I  +  TM)  =  0  for  some 
diagonal  and  real  T, 


l  0 


otherwise 


We  point  out  that  ^i(M)  is  different  from  pir&(M)  with  0  =  0  (for  ease  of  reference,  we  will  call  the 
latter  quantity  //r+  and  its  upper  bound  given  in  (3.16)  by  (tm+).  The  difference  between  /ii  and  is  that 
with  the  uncertainty  is  required  to  be  nonnegative,  unlike  with  the  definition  of  /i®.  For  this  reason ,  we 
will  refer  to  as  “ two-sided  real-pi”,  while  we  will  call  pL&  +  “one-sided  real-fj 

The  upper  bound  for  the  two-sided  real-pi  from  [FTD91]  and  [Bal95]  can  be  easily  adapted  via  a  loop 
transformation  to  yield  an  upper  bound  for  the  one-sided  real-pi.  This  upper  bound  on  is  just 


m +(M)  =  inf 


-2 7S  -  S(I  +  j B)M  -  M*{I  -  j B)S  <  0 
7  >  0,  Sy  B  diagonal,  S  >  0 


(3.17) 


Remarkably,  computing  pL-^+  using  (3.1 7)  has  the  same  complexity  as  computing  (ty&+  using  (3.16).  Extensive 
numerical  simulations  suggest  that  this  upper  bound  is  tighter  than  the  bound  (3.16).  We  should  note  however 
that  the  bound  (3.17)  does  not  extend  to  the  case  of  general  phase-bounded  uncertainty  considered  in  this 
chapter. 

Finally,  we  note  that  it  is  possible  to  adapt  pt^+,  the  upper  bound  for  the  one-sided  real  pi,  to  yield  an 
upper  bound  for  the  two-sided  real  pi.  This  upper  bound  on  pi^  turns  out  to  be 

f  .  M*{2R+2S)M-y2R  +  y((S-R  +  jB)M-M*(2S- R-jB))  <  0  1 
m  *  7  >  0,  S,  B  diagonal,  S  >  0  j 


However,  we  know  of  no  efficient  way  of  computing  this  upper  bound. 
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3.4  Computing  supw/ir0(w)(P(ja;)) 

From  Theorem  3  in  §3.2.2,  it  should  be  clear  that  the  computation  of  sup  fir  (P(ju;)),  which  we  shall 

C  ®(w) 

denote  by  M©(P),  is  of  considerable  interest.  For  reasons  pointed  out  at  the  beginning  of  §3.3,  we  will 
consider  instead  the  problem  of  computing  sup w  ftv  (P(ju;)),  which  we  shall  denote  by  A4©(P).  Since 

e(w)  ' 

Xi@(P)  >  Me(P),  computing  M©(P)  will  enable  us  to  state  sufficient  conditions  for  the  stability  of  the 
system  in  Fig.  3.1. 

For  each  frequency  the  quantity  jxv  ^  (P(ju;)),  defined  in  Corollary  1,  can  be  computed  as  the  solution 
to  a  quasi-convex  optimization  problem.  There  are  several  ways  of  showing  this;  we  will  demonstrate  one 
method.  For  convenience,  we  let  M  =  P( jo;). 

Recall  that  /2r@  is  given  by  (3.13).  Let  T  =  BS.  Then  the  condition  on  B  is  equivalent  to 

AS  >  T  >  -AS, 

where  A  is  a  constant  diagonal  matrix  given  by 

A  =  diag  (cot  (Qi(u))  h , ,  •  •  • ,  cot  (0*(w))  Ikl)  ■ 

Thus  p,Fe  is  given  as  the  optimal  value  of  7  obtained  by  solving  the  problem 
minimize  y2 

subject  to  7 2R  >  M*RM  -  ( SM  +  M*S)  -  j (TM  -  M*T) 

AS  >T>  -AS, 

R  =  diag(ri/fcl , . . . ,  rt Ikt),  r,-  >  0  ^3'18^ 

S  —  diag(si/t1, . .  ,,S(Ike),  Si>  0 

T  =  diagpj/i,, . .  .,tilkt) 


With  v  =  72,  the  optimization  variables  in  this  problem  are  v ,  R ,  5  and  T.  Problem  (3.18)  is  one  of 
minimizing  a  linear  objective  v ,  subject  to  constraints  on  v ,  R,  S  and  T  that  are  convex  (in  fact,  linear 
matrix  inequalities2)  in  R ,  S  and  T  for  fixed  v ,  and  vice  versa.  It  can  be  shown  that  problem  (3.18)  is  a  quasi- 
convex  optimization  problem  [BEFB94].  Much  work  has  been  done  lately  on  problems  such  as  (3.18):  it  is 
well-known  that  such  problems  have  polynomial  worst-case  complexity;  moreover,  very  efficient  algorithms 
and  software  tools  are  available  for  their  solution  [GN95,  GDN95]. 

Next,  we  have  the  following  obvious  lower  bound  on  A i©(P). 

Lemma  3.4.1  Lei  fi  =  {wo,  . . . ,  be  a  set  of  frequencies.  Then ,  Mq(P,  fi),  defined  as 

Mq(P,  A)  =  max  , 

satisfies  A4@(P,  Q)  <  M©{P),  i.e.,  it  is  a  lower  bound  on  M©(P). 

In  order  to  compute  Mq(P,  0),  we  need  to  solve  N  +  1  quasi-convex  optimization  problems  of  the 
form  (3.18).  Of  course,  the  number  and  choice  of  frequencies  comprising  Q  determines  how  tight  a  bound 
A4g(P,Q)is. 

Remark  3.4.1  The  lower  bound  given  by  Lemma  S.f.l  suffers  from  a  possible  shortcoming:  It  is  known 
that  in  general,  jlr  (P(jo;))  may  be  discontinuous  as  a  function  ofco.  Specifically,  £ir  (P(ju))  might 
only  be  upper  semiconiinuous,  and  therefore  we  have  no  guarantees  with  the  convergence  of  the  lower  bound 
A4q(P,  f2)  to  Mq(P)  even  if  N ,  the  number  of  elements  ofQ,  tends  to  oo  ( but  a  scheme  analogous  to  that 
proposed  in  [LTD96]  might  be  applicable).  However,  in  most  engineering  applications  (as  we  will  see  in  § 3.5 ), 
this  does  not  pose  a  serious  problem. 

2  A  linear  matrix  inequality  or  an  LMI  is  a  matrix  inequality  of  the  form  F(a?)  =  Fq  +  X^i-i  X*P  >  0  or  F(x)  >  0,  where 
F,  are  given  Hermitian  matrices,  and  the  2?,s  are  the  real  optimization  variables. 
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It  is  also  possible  to  compute  upper  bounds  on  Me(P)  using  state-space  methods.  The  basic  idea  is  this. 
M@(P)  <  7  if  and  only  if  there  exist  R  :  jM  -*•  Mnxn,  5  :  jM  ->■  Mnx"  and  T  :  jM  — ►  Mnxn  suck  that  for 
every  w  6  Me,  the  following  constraints  are  satisfied  (the  dependence  of  A  on  w  is  now  made  explicit). 


(i)  y2R(ju)  >  P(ju>)*P(jw)P(ju>)  -  (5(jw)P(jw)  +  PQu>yS(jw))- 
j(T(jW)P(jW)  -  P(jw)*r(jw)), 


(ii) 

A(w)SGw)  >  T( j«), 

(hi) 

T(ju>)  >  -A(w)S(jw), 

(iv) 

R( )w)  =  diag(ri(jw)4,,. 

.  .,re(jw)Ike), 

n(jw)  >  0 

(v) 

S(jw)  =  diag(si(jw)41, . 

..,st(iuj)Ik(), 

Si(jw)  >  0 

(Vi) 

T(jw)  =  diag^iCjw)/*,,. 

••.<r(jw)4J 

It  can  be  shown  [CTB97b]  that  the  constraints  in  (3.19)  hold  for  some  -y  if  and  only  if  they  hold  for 
some  real-rational  transfer  functions  R,  S  and  T.  This  fact  can  be  combined  with  the  Positive- Real  (PR) 
lemma  [Willi,  AV73]  to  write  down  LMIs  whose  feasibility  is  equivalent  to  conditions  (i)-(v)  (see  for  exam¬ 
ple,  [Bal95,  CTB97b]  for  an  illustration  of  this  procedure).  Thus,  a  sufficient  condition  for  the  feasibility  of 
problem  (3.19)  can  be  recast  as  an  LMI  feasibility  problem.  A  bisection  scheme  can  then  be  used  to  compute 
an  upper  bound  for  Me (P).  It  is  also  possible  to  avoid  the  bisection  scheme  altogether,  by  recasting  the 
upper  bound  computation  problem  as  a  single  generalized  eigenvalue  minimization  problem;  see  [BW], 


3.5  Numerical  examples 

We  demonstrate  on  a  few  examples  the  application  of  stability  tests  based  on  the  PS-SSV . 


3.5.1  Example  1:  Stability  of  a  flexible  structure 

We  consider  the  stability  of  a  planar  truss  structure,  with  a  model  adapted  from  the  one  presented  in  [1091]. 
The  truss  structure  has  sixteen  free  nodes,  each  with  two  degrees  of  freedom;  thus  it  exhibits  thirty-two 
flexible  modes.  We  assume  that  the  first  mode  is  exactly  modeled  as  a  linear  time-invariant  system,  with 
transfer  function  p  given  by 

0.3927V 

P ^  ~  s2  +  2(0.0075)(131)s  +  1312 ' 

The  remaining  modes  are  modeled  as  a  linear  time-invariant  uncertainty,  with  transfer  function  denoted  by 
6(s).  It  is  known  that  6  is  stable,  and  satisfies 

|<5(jw)|  <  0.3370,  Re<5(jw)  >  0,  for  all  u£l,  (3.20) 


that  is,  6  is  passive,  and  has  an  Hoc  norm  bound  of  0.3370.  A  linear  time-invariant  controller  c  with  transfer 

fUnCtl°n  2.38s5  +  33.18s4  +  40842.00s3  +  489341.01s2  +  203926.51s  +  489289.16 

-  s5  +  15.15s4  +  10927.81s3  +  163193.36s2  +  587196.79s  +  434923.70 
has  been  designed  to  stabilize  p(s),  placing  the  poles  at  -1,  -4  and  -10.  The  robust  stability  question  then 
is  whether  the  controller  stabilizes  p  +  6. 

The  block  diagram  of  the  system  is  shown  in  Fig.  6(a).  The  system  redrawn  in  our  analysis  framework 
is  shown  in  Fig.  6(b),  where  g  -  c/(  1  +pc).  The  magnitude  and  real  part  of  g  are  shown  in  Fig.  3.7. 

From  an  inspection  of  these  plots,  and  the  properties  of  6  given  in  (3.20),  we  conclude  that: 


•  The  small  gain  theorem  does  not  prove  stability  of  the  system  in  Fig.  6(b),  since  the  Hoo  norm  of  g 
exceeds  1/0.3370. 

•  The  passivity  theorem  does  not  prove  stability  of  the  system  in  Fig.  6(b),  since  g  is  not  strictly  passive 
(the  real  part  of  </(jw)  is  nonpositive  for  some  u>). 
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(a)  Block  diagram  of  the  flexible  truss  structure.  (b)  Block  diagram  redrawn  in 

our  framework. 


Figure  3.6:  Example  1:  Models  of  the  flexible  truss  structure. 


Figure  3.7:  Example  1:  Frequency  response  of  g. 


However,  the  analysis  techniques  presented  in  this  chapter  do  prove  uniform  robust  stability.  A  plot  of 
Azre(5f(ja;))  is  shown  in  Fig.  3.8.  (Since  g  is  a  scalar  transfer  function,  is  trivial  to  compute.)  Since 
suPw€i&e  Pre^ti^))  <  1/0.3370,  the  system  in  Fig.  6(b)  is  indeed  uniformly  robustly  stable. 


3.5.2  Example  2:  Analysis  of  parametric  systems 

We  next  consider  the  problem  of  uniform  robust  stability  of  the  closed-loop  system  shown  in  Fig.  9(a).  P  is 
the  parameter-dependent  plant,  with  transfer  function  given  by 


P(s)  =  diag(p1(s),p2(s)),  Pi(s)  = 


a,i(s  +  b{) 


s2  +  2 CiS  -b  1  ’ 
and  C  is  the  controller  with  the  transfer  function 

s2  +  s  -  1 
I  7 

C(s)  =  0.3 


o>i  E  [0,1],  bi  £  [1,2],  a  £  [1,2], 


5+1 


(s  -f  l)(s  4*  2) 

1 


s  +  2 
5+1 
5+10 


The  problem  now  is  to  ascertain  the  stability  of  this  system  for  all  allowable  values  of  the  parameters. 

Fig.  3.10  shows  the  values  of  the  frequency  response  of  pt*,  over  a  number  of  allowable  parameter  values, 
at  a  sample  list  of  frequencies.  This  figure  indicates  that  each  pi  is  passive,  and  has  a  frequency  response 
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Figure  3.8:  Example  1:  The  PS-SSV  of  g{']u>)  versus  w. 


(a)  Block  diagram  of  the  parameter-dependent  system. 


(b)  Block  diagram  redrawn  in 
our  framework. 


Figure  3.9:  Example  2:  Stability  analysis  of  a  parameter-dependent  system. 


which  can  be  described  as  satisfying  certain  magnitude  and  phase  constraints.  Fig.  3.11  shows  the  magnitude 
and  phase  constraints  on  each  of  the  terms. 

This  problem  can  be  posed  in  our  PS-SSV  framework,  as  shown  in  Fig.  9(b).  The  uniform  robust  stability 
condition  is 

sup  a(P( jW)K  (e»<“>C(j«))  <  1,  (3-21) 

where  i/>(w)  and  the  entries  of  0(w)  are  plotted  against  ui  in  Figs.  11(b)  and  11(c),  respectively.  For  conve¬ 
nience  we  let  C(jw)  =  d'Ku'>C(ju).  A  plot  of  /ir  (<?(jw))  is  shown  in  Fig.  3.12,  in  solid  lines.  For  reference, 

the  optimally  scaled  maximum  singular  value  of  C'()u>)  is  shown  in  dotted  lines;  this  is  an  upper  bound  on 
//(C(jw)),  which  can  be  thought  of  as  an  upper  bound  on  PS-SSV  that  does  not  use  the  phase  information. 
Since  condition  (3.21)  holds,  the  system  in  Fig.  9(b)  is  indeed  uniformly  robustly  stable.  Note  that,  since 
a(PQO))  =  2,  the  bound  on  PS-SSV  that  does  not  use  the  phase  information  does  not  yield  this  conclusion. 

Remark  3.5.1  There  is  a  more  direct  method  of  analyzing  parameter-dependent  systems,  namely  “real-p” 
analysis  ( see  [FTD91]).  It  is  of  interest  to  compare  PS-SSV-based  stability  methods  with  real-p  methods. 

Let  us  consider  the  question  of  whether  the  system  in  Fig.  9(b)  is  uniformly  robustly  stable.  The  answer 

is  affirmative  in  the  PS-SSV  framework  i/supweKs  or(P(jw))/ire^)  ^<5(jw)^  is  less  than  one.  Checking  this 
numerically,  from  the  discussion  in  §3-4  (in  particular,  Lemma  3.4-1),  requires  the  solution  of  N  LMI 
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=  0.01  rad/sec  w  =  0.05  rad/sec  w  =  0.1  rad/sec  to  ~  0.2  rad/sec 


=  0.5  rad/sec  u»  =  1  rad/sec  U)  =  2  rad/sec  o'  —  5  rad/sec 


Figure  3.10:  Example  2:  Frequency  response  of  each  pi  at  a  number  of  frequencies. 


feasibility  problems ,  one  for  each  frequency.  Let  us  consider  one  such  feasibility  problem .  The  variables  in 
this  problem  are  diagonal  2x2  matrices  R,  S  and  T.  Thus,  the  number  of  scalar  variables  is  6.  There  is 
one  LMI  constraint  of  size  2x2,  and  6  scalar  constraints. 

When  the  uniform  robust  robust  stability  of  the  same  system  is  posed  in  the  real-fi  framework  of  [FTD91], 
we  once  again  have  to  solve  an  LMI  feasibility  problem  at  each  frequency.  Here  the  variables  in  each  problem 
are  diagonal  6x6  matrices  D  =  DT  and  G  =  GT  (see  [FTD91]  for  details);  thus  the  number  of  scalar 
optimization  variables  is  12.  There  is  one  LMI  constraint  of  size  6x6,  and  6  scalar  constraints. 

For  the  problem  of  uniform  robust  stability  with  parametric  uncertainties,  PS-SSV-based  tests  are  likely 
to  be  more  conservative  than  real- pi  tests.  However,  it  should  be  clear  from  the  number  of  variables  and 
constraints  that  the  amount  of  computation  required  by  PS-SSV-based  methods  is  less  than  that  required  by 
real-pi  methods  For  our  example,  empirical  studies  indicate  that  the  computation  required  by  real-ji  methods 
is  approximately  12  times  that  required  by  PS-SSV-based  methods  [VB95].3  Thus,  the  PS-SSV  approach 
can  be  useful  in  analyzing  parameter-dependent  systems,  albeit  more  conservatively,  when  the  number  of 
parameters  is  large. 

3.5.3  Example  3:  Experimentally  measured  matrix  phase  information 

We  consider  an  uncertain  system  as  in  Fig.  3.1,  where  the  plant  P  is  strictly  proper  (i.e,  P(oo)  —  0),  has 
two  inputs,  two  outputs,  and  a  state-space  realization  ( A ,  B,  C)  with 


'  -1  0  1  ' 

'  -1  -1  ' 

„  1 

'-10  1  ' 

A- 

0  -1  1 

0  -2  -3 

,  B  = 

-1  1 

1  1 

’  C=7 

!  2  -2 

We  assume  that  the  two-input  two-output  LTI  uncertainty  A  has  been  experimentally  measured  at  a 
number  of  frequencies.  A  scatter-plot  of  the  phase  information  of  A(jw)  at  a  number  of  frequencies  is  shown 
in  Fig.  13(a);  a  scatter-plot  of  the  norm  of  A(jw)  at  a  number  of  frequencies  is  shown  in  Fig.  13(b). 

3  In  general,  for  an  LMI  problem  with  l  variables  and  L  LMI  constraints  of  size  n,Xn,,  the  computation  required  is  dominated 
by  O  (fc2X)f=  l  n‘("'  +  1)/2)' 
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(a)  Magnitude  constraints  on 


(c)  Magnitude  of  variation  of 
4>(Pi{ j^))  about  its  average. 


Figure  3.11*  Example  2:  Magnitude  and  phase  constraints  on  p2(jo;). 


From  the  scatter  plot  shown  in  Fig.  13(a),  we  can  determine  continuous  functions  <f>\h  and  </>ub  such  that 
for  every  frequency  u  and  A,  the  smallest  sector  containing  W"(A(ja;))  is 

{z  :  z  =  rej^}  r  >  0,  ip  G  [<£ib(^)>  ^ub(^)]}  • 

(These  functions  are  shown  in  solid  lines  in  Fig.  13(a).)  Also,  from  Fig.  13(b),  we  can  determine  a  function 
d(v)  such  that  for  every  frequency  uj  and  A, 

<r(A(ju>))  <  d(u)' 

(This  function  is  shown  in  a  solid  line  in  Fig.  13(b).) 

Then,  defining  6(lo)  —  0.5(<^ub(w)  ~  ^ib(w))  and  =  0.5(<^ub(^)  +  ^ib(w))5  we  have  that  the  system 
in  Fig.  3.1  is  uniformly  robustly  stable  if 

sup  ^re(ui)  (eWMp(j«))  d(w)  <  1, 

where  in  the  notation  of  §3.2.2,  =  2,  and  0  =  (#).  The  upper  bound  (P(jw)e^^  ■*)  from  (3.13) 

is  obtained  for  various  w  by  solving  the  optimization  problem  (3.18),  and  plotted  in  Fig.  3.14.  Since 
suPa/eK./Ve;  )(ej'/'(a')p(jw))d(w)  <  the  system  in  Fig.  3.1  is  indeed  uniformly  robustly  stable. 

3.6  Conclusions 

The  “phase-sensitive  structured  singular  value”  framework  developed  in  this  chapter  provides  an  effective 
robustness  analysis  tool  in  various  situations,  e.g.,  in  the  case  when  the  uncertainty,  besides  being  (possibly 
block-structured  and)  small,  is  known  to  be  passive. 

Several  issues  have  been  left  unresolved. 

1.  Under  what  “minimal”  assumptions  on  $(•)  are  statements  (a),  (b)  and  (c)  of  Theorem  1  equivalent? 

2.  In  the  presence  of  non-scalar  “full  blocks”,  and  with  0  constant,  are  statements  (a)  and  (b)  in  Theo¬ 
rem  3  equivalent  to  the  analogue  of  statement  (c)  in  Theorem  1,  namely 

(c)  (/  +  AP)"1  G  Hoc  for  all  A  G  RHoo  D  A  and  supi€RHoonA  ll(^  +  AP)-1||oo  <  oo. 

3.  When  is  the  upper  bound  /trQ  defined  in  Corollary  1  of  §3.3  equal  to  /^re,  in  particular  is  it  always 
equal  to  //Fe  when  l  =  1  (full  block  uncertainty)? 

The  answer  to  some  of  these  questions  may  be  within  reach. 

The  contributions  in  the  chapter  can  be  generally  viewed  as  the  following:  When  the  uncertainty  A  in 
Fig.  3.1  is  LTI,  and  when  additional  information  on  the  phase  of  the  frequency  response  of  A  is  available, 
we  have  derived  sufficient  (and  sometimes  necessary)  conditions  for  robust  stability.  A  natural  extension  of 
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0.7 


0.6 


0.5 


uj  (rad/sec) 

Figure  3.12:  Example  2:  The  upper  bound  on  /xre(w)  is  plotted  against  u>  in  solid  lines.  The 

optimally  scaled  maximum  singular  value  of  CQco)  is  plotted  against  u  in  dotted  lines. 


this  problem  considered  in  this  chapter  is  the  following.  Consider  for  simplicity  the  case  when  A  is  a  scalar 
uncertainty,  and  suppose  that  it  is  known  that  the  Nyquist  plot  of  A  is  restricted  to  lie  in  some  region  in 
the  complex  plane  that  can  be  described  as  the  intersection  of  generalized  disks  (i.e.,  disks  and  half-spaces). 
Then,  we  can  derive  a  sufficient  robust  stability  condition  by  combining  robust  stability  conditions  for  each 
generalized  disk,  just  as  we  did  to  arrive  at  Theorem  5.  As  a  further  extension  along  these  lines,  consider 
the  situation  when  the  Nyquist  plot  of  A  is  restricted  to  lie  in  some  region  in  the  complex  plane  that  can 
be  described  as  the  union  of  sets  which  are  themselves  obtained  as  an  intersection  of  generalized  disks.  (A 
classic  example  of  such  a  region  is  the  “butterfly”  uncertainty  set,  described  in  [LT92a].)  The  techniques 
described  in  this  chapter  can  be  extended  to  handle  these  more  general  cases  as  well. 

The  focus  of  this  chapter  has  been  exclusively  on  uncertainties  about  which  phase  information  is  available. 
The  techniques  herein  can  be  combined  with  other  standard  robustness  analysis  techniques  such  as  complex 
or  real-//  analysis,  when  phase  information  about  only  certain  blocks  of  the  uncertainty  is  available,  leading  to 
a  new  “mixed-//”  paradigm.  Finally,  while  the  theory  was  developed  for  the  continuous-time  case,  extension 
to  discrete  time  is  straightforward. 


Appendix  A 


Proposition  2  Let  6  E  (0, 7r],  let  E  M  \  {0},  and  let  7  E  C+  be  such  that  [7]  <  1  and  |<^>(t) I  <  0*  There 
exists  6  E  RHqo,  continuous  on  Cfe>  such  that  <$(jw)  =  7  and  such  that  ||<5||oo  <  1  and  sup^  €K  W*((j«)))l  < 

e. 


Proof:  If  7  =  0,  simply  let  8  map  C+  to  zero.  Assume  now  7  /  0.  Let  V  —  \z  E_C  :  \z\  <  1}  and  let 
V6  =  {z  E  V  :  Rez  >  0,  \<j>(z)\  <  9}.  We  first  construct  a  non-rational  mapping  8  :  V  — +  C,  taking  real 
values  on  the  real  axis,  such  that  8{V )  belongs  to  Ve  and  contains  7  and  1/2 -fjO  in  its  interior.  This  map 
is  selected  from  a  one-parameter  family  of  mappings  8X  :  V  — >  C,  A  E  (0, 1),  constructed  as  the  composition 

of  two  maps,  i.e.,  8X  —  82  o  8\  . 

First,  for  A  E  (0, 1),  the  map  8\  ,  defined  on  X>,  is  given  by 


~  a  1  4-  \z  —  (1  —  2Az  cos rj)  +  (Az)2)1/2 

1  1  +  Xz  +  (1  —  2\z  cos  tp  +  (Az)2)1/2  ’ 


with  sin  (VV^)  = 


A 

2- A* 
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(a)  Scatter  plot  of  the  MP(A(ju/))  +  PS(A(jw))  (de-  (b)  Scatter  plot  of  the  norm  of  A(j w)  (for  various  A) 

noted  by  “+”)  and  MP(A(jo>))  -  PS(A(ju;))  (denoted  versus  u/. 

by  for  various  A,  versus  w. 


Figure  3.13:  Example  3:  Experimentally  determined  magnitude  and  phase  characteristics  of  A. 

For  fixed  A,  6\ A  maps  V  to  the  interior  of  a  set  such  as  the  one  depicted  in  Fig.  15(a). 

Next  <52A,  defined  on  81  (V),  is  given  by 

62 X(w)  =  (w  +  (1  -  A))'’/*  . 

(In  the  definition  of  and  62  >  given  £  =  pe^ ,  with  p  >  0,  and  (p  G  (— 7r,  7r],  and  given  p  G  (0, 1],  we  set 
(P  —  pPeiJ,tp.  In  other  words,  the  “cut”  is  taken  along  the  negative  real  axis.)_It  is  readily  checked  that,  for 
every  A  G  (0, 1),  8X  takes  real  values  on  the  real  axis.  For  fixed  A  G  (0, 1),  5A( 2?)  is  as  depicted  in  Fig.  15(b) 

(it  belongs  to  Ve).  _  _  _ 

As  A  — ►  1,  the  boundary  of  8X(V)  uniformly  approaches  that  of  V6 .  As  the  next  step,  we  select  6  =  6X' 
where  A*  G  (0, 1)  is  such  that  both  7  and  1/2  +  jO  belong  to  the  interior  of  8X'  (V).  We  next  define  8  as  a 
truncated  Taylor  series  of  6  about  1/2 +j0,  with  the  properties  that  5(2?)belongs  to  Vs ,  and  that  7  belongs 
to  6(V).  The  existence  of  such  <5  is  a  direct  consequence  of  the  uniform  convergence  of  the  Taylor  series. 
Since  6  is  real  on  the  real  axis,  6  is  a  polynomial  with  real  coefficients.  Further,  a  real-rational  mapping  6 
is  defined  as  the  composition  of  the  mapping  s  >— +  (s  —  1  )/(s  +  1),  which  maps  C+  to  T> ,  with  £<5,  where 
£  G  (0, 1)  is  such  that  7  belongs  to  the  boundary  of  £<5(2?).  It  is  readily  checked  that  the  image  under  8  of  the 
imaginary  axis  is  this  boundary.  Also,  since  6(C+)  belongs  to  T>s,  it  obviously  is  bounded  in  the  right  half 
plane.  Finally,  we  let  8(s)  =  6(|s),  where  ui  G  M  U  {00}  is  such  that  <5(jw)  =  7.  (In  particular,  ifw  G  {0,oo}, 
7  is  real  (since  8  is  real  rational)  and  6(s)  =  7  for  all  s.)  Clearly,  8  has  all  the  claimed  properties.  □ 
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Chapter  4 

Efficient  Computation  of  a 
Guaranteed  Lower  Bound  on  the 
Robust  Stability  Margin 


Sufficient  conditions  for  the  robust  stability  of  a  class  of  uncertain  systems,  with  several  different  as¬ 
sumptions  on  the  structure  and  nature  of  the  uncertainties,  can  be  derived  in  a  unified  manner  in  the 
framework  of  integral  quadratic  constraints.  These  sufficient  conditions,  in  turn,  can  be  used  to  derive 
lower  bounds  on  the  robust  stability  margin  for  such  systems.  The  lower  bound  is  typically  computed 
with  a  bisection  scheme,  with  each  iteration  requiring  the  solution  of  a  linear  matrix  inequality  feasibil¬ 
ity  problem.  We  show  how  this  bisection  can  be  avoided  altogether  by  reformulating  the  lower  bound 
computation  problem  as  a  single  generalized  eigenvalue  minimization  problem,  which  can  be  solved  very 
efficiently  using  standard  algorithms.  We  illustrate  this  with  several  important,  commonly-encountered 
special  cases:  Diagonal,  nonlinear  uncertainties;  diagonal,  memoryless,  time-invariant  sector-bounded 
(“Popov”)  uncertainties;  structured  dynamic  uncertainties;  and  structured  parametric  uncertainties.  We 
also  present  a  numerical  example  that  demonstrates  the  computational  savings  that  can  be  obtained  with 
our  approach. 


4.1  Introduction 


We  revisit  the  interconnection  of  a  linear  system  with  transfer  function  H(s)  and  an  uncertainty  or  pertur¬ 
bation  A,  shown  in  Fig.  4.1,  and  described  by 

x  =  Ax  +  Bw,  z  =  Cx  +  Dw,  w  =  e+yp,  p=Aq,  q  =  f  +  z,  (4.1) 

where  x(t)  G  Rn,  w(t)  G  R"“,  z(t)  G  Rn‘,  A,  B,  C  and  D  are  real  matrices  of  appropriate  sizes,  and 
A  :  L£'[0,oo)  —*  L"u’[0,oo).  We  assume  that  all  the  eigenvalues  of  A  have  negative  real  parts.  We  also 
assume  that  nz  =  nw  =  m;  the  results  herein  can  be  extended  with  little  difficulty  to  cover  the  more  general 
cases.  Finally,  we  assume  that  system  (4.1)  is  well-posed. 


w 


H(s) 


-©**■ 


Figure  4.1:  A  standard  framework  for  robustness  analysis 

0  Joint  work  with  Fan  Wang,  Ph.D.,  School  of  Electrical  and  Computer  Engineering,  Purdue  University. 
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The  framework  that  we  use  in  this  chapter  for  modeling  the  uncertainty  is  based  on  the  notion  of  Integral 
Quadratic  Constraints  or  IQCs\  see  [MR97]  and  the  references  therein.  Borrowing  notation  and  terminology 
from  [MR97],  two  signals  p  £  L™[0,  oo)  and  gGL^O.oo),  with  Fourier  Transforms  p  and  q  respectively,  are 
said  to  “satisfy  the  IQC  defined  by  II”,  if 


r  \  gw ' 

J- oo  [  p(i") . 


n(j'w) 


?0'w) 

p(j'w) 


dto  >  0, 


where  II  :  j R  — »  C2mx2m  is  a  measurable  Hermitian  function,  bounded  on  the  imaginary  axis.  We  also  say 
that  A  :  L™[0,  oo)  — +  L™[0,  oo)  “satisfies  the  IQC  defined  by  II”,  if  for  every  q  £  L™[0,  oo),  q  and  A q  satisfy 
the  IQC  defined  by  II. 

With  the  above  terminology,  we  assume  that  A  lies  in  the  set 

A  ~  {A  |  For  every  II  £  II,  any  rA  satisfies  the  IQC  defined  by  II,  where  r  £  [0, 1]},  (4-2) 


where  II  is  some  specified  set.  (We  will  consider  a  number  of  special  cases  for  II  in  the  sequel.)  The  set  II  can 
be  thought  of  as  summarizing  all  the  information  known  about  A.  We  will  make  the  following  assumption 

tin  n 1 2 


about  II:  Partitioning  any  II  £  II  as  II  = 


ni2  n 


22 


we  assume  that: 


For  some  e  >  0,  for  all  u>  £  R,  II n(jca)  >  2e  and  Il22(jw)  <  — 2e. 


(4.3) 


We  shall  see  in  §4.3  that  for  a  number  of  commonly  encountered  uncertainty  descriptions,  the  set  II 
defining  the  corresponding  IQCs  satisfies  this  assumption;  thus  it  is  not  very  restrictive. 

Given  some  7  >  0,  we  say  that  system  (4.1)  is  robustly  stable  if  it  is  I^-stable  (see  [DV75])  for  every 
A  £  A.  The  quantity  of  interest,  in  this  chapter,  is  the  robust  stability  margin  of  system  (4.1),  which 
is  defined  as  the  largest  7  such  that  system  (4.1)  is  robustly  stable.  The  quantity  is  very  useful  in 
practice,  as  it  has  the  interpretation  of  the  largest  uncertainty  size  for  which  the  H- A  interconnection  is 
robustly  stable.  It  is  well-known  that  computing  jm  exactly  is  an  NP-hard  problem  in  several  important 
and  commonly-encountered  situations  [BYDM94].  (Roughly  speaking,  this  means  that  the  computational 
effort  required  to  compute  7m  to  within  a  given  accuracy  grows  more  than  polynomially  with  the  problem 
size.)  Therefore,  we  will  be  content  with  computing  lower  bounds  on  7m. 

For  fixed  7,  a  number  of  sufficient  conditions  for  the  robust  stability  of  system  (4.1)  exist,  depending  on 
A.  When  A  can  be  any  operator  satisfying  an  I/2-gain  bound,  the  small-gain  theorem  provides  a  necessary 
and  sufficient  condition  for  robust  stability.  When  A  is  structured — say  diagonal — the  small  gain  condition  is 
no  longer  necessary  for  stability;  diagonal  scalings  can  then  be  used  to  derive  less  conservative  robust  stability 
conditions  [Doy82,  Saf82].  In  addition,  if  A  is  a  memoryless  time-invariant  sector-bounded  nonlinearity,  the 
celebrated  Popov  criterion  yields  a  sufficient  condition  for  robust  stability  (see  for  example,  [DV75]).  When 
A  is  LTI  or  parametric,  the  well-known  p  analysis  and  Km  analysis  methods  provide  sufficient  conditions  for 
robust  stability  [BDG+91,  CS92,  FTD91].  It  has  been  noted  recently  that  several  of  these  stability  criteria 
can  be  unified  in  the  setting  of  stability  analysis  using  IQCs  [MR97].  These  stability  criteria  can  be  used 
to  define  a  guaranteed  lower  bound  on  7m  (as  the  largest  7  for  which  robust  stability  can  be  proved  using 
the  IQC  framework).  The  computation  of  the  lower  bound  on  7m  thus  defined  requires  bisection  schemes, 
with  each  iteration  requiring  the  solution  of  a  convex  feasibility  problem,  typically  a  linear  matrix  inequality 
(LMI)  feasibility  problem  [J96,  SC93,  HH93b,  LSC94,  Bal95,  Hel95]. 

The  main  contribution  of  this  chapter  is  to  show  how  bisection  can  be  avoided  altogether,  by  reformulating 
the  lower  bound  computation  problem  as  a  single  generalized  eigenvalue  minimization  problem  (GEVP)1. 
This  is  a  quasiconvex  optimization  problem  over  LMIs,  and  can  be  solved  very  efficiently  using  standard 
algorithms  and  software  (see,  for  example,  [BEFB94,  BE93]  and  [GN95]).  We  also  present  examples  that 
illustrate  the  computational  improvement  obtained  with  our  approach. 

The  organization  of  the  chapter  is  as  follows.  In  §4.2,  we  very  briefly  review  the  robust  stability  analysis 
of  system  (4.1)  using  the  IQC  framework.  We  then  show  how  to  recast  the  robust  stability  margin  lower 
bound  computation  problem  as  a  GEVP.  In  §4.3,  we  illustrate  our  approach  on  several  important  commonly- 
encountered  special  cases  for  the  set  of  uncertainties  A.  In  §4.4,  we  compare  the  computational  effort  of  the 
GEVP  and  bisection  schemes  with  a  simple  numerical  example. 

1 A  similar  reduction  of  the  stability  margin  calculation  to  a  GEVP  was  also  made  in  [J96],  however  with  severe  restrictions 
on  the  system  matrices. 
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4.2  Robust  stability  margin  bound  via  generalized  eigenvalue  min¬ 
imization 


We  review  a  robust  stability  criterion,  taken  from  [MR97],  for  systems  with  uncertainties  described  by  IQCs. 
(For  all  the  uncertainties  considered  here,  this  stability  criterion  can  be  derived  via  an  application  of  the 
passivity  theorem  with  multipliers,  see  for  example,  [DV75,  HH93b,  SC93,  Bal95].) 

Given  some  7  >  0,  a  sufficient  condition  for  the  stability  of  system  (4.1)  for  all  A  G  A  is  given  by  the 
following  lemma  [MR97,  Theorem  1], 

Lemma  4.2.1  Suppose  that  the  interconnection  ofH(ju)  and  tA  in  Fig.  4-1  is  well-posed  for  any  r  G  [0,7] 
and  any  A  G  A.  Then,  if  there  exist  IT  G  II  and  e  >  0  such  that 


7  H{ju) 
I 


n(jw) 


■yH(jui) 

I 


<  — 2el ,  for  all  u  G  R, 


(4.4) 


system  (4-1)  is  robustly  stable  for  all  A  G  A. 

The  above  sufficient  condition  for  the  robust  stability  of  system  (4.1)  yields  a  lower  bound  for  the  robust 
stability  margin  via  the  following  optimization  problem: 


Maximize:  7 

Subject  to:  There  exist  II  G  II  and  e  >  0  such  that  (4.4)  holds. 


(4.5) 


We  now  describe  the  current,  commonly  used  technique  for  the  numerical  solution  of  Problem  (4.5)  (see 
for  example  [J96]).  In  general,  II — the  set  defining  the  IQCs  corresponding  to  A — is  not  described  by  a 
finite  number  of  variables.  In  order  to  reduce  the  number  of  optimization  variables  to  a  finite  number,  a 
subset  of  II  is  defined  as 


Hfin 


<  n 


n  {ju)  = 


W(ju)  = 


W(ju)*RnW(ju)  W(ju)*  R12W(jaj) 
W(jL>yRj2W(jL>)  -W(ju)*R22W(ju)  J  * 


Cwijojl  —  Aw)  lBw 

fill  Rl2 

Dw 

J 

.  R\2  -R22  . 

for  some  e  >  0,  for  all  u>  €  R, 

W(ju>yRuW(jw)  >  2 el,  W(ju>y R22W{ju)  >  2 el  J 


(4.6) 


where  Aw  G  Rn^xn^,  Bw  G  RnwXm,  Cw  G  RKxnw,  Dw  G  RLxm,  and  Q  is  an  appropriately  chosen 
subspace  of  r2(k+l)*2(k+l) .  (We  will  see  specific  examples  in  §4.3.) 

Remark  4.2.1  It  is  typically  computationally  more  efficient  to  parameterize  the  various  blocks  II ^  of  II 
in  (4.6)  as  Uij(ju)  =  Wi(ju)*  RijWj  where  and  Wj  are  different  transfer  functions.  However ,  for 
simplicity  of  presentation,  we  will  continue  with  the  definition  of  IIfin  as  in  (4-6),  noting  that  the  development 
herein  can  be  readily  extended  to  the  more  general  case. 

With  II  restricted  to  lie  in  IIfin,  we  have  another  lower  bound  on  the  robust  stability  margin  via  the  following 
finite-dimensional  optimization  problem: 


Maximize:  7 

Subject  to:  There  exist  II  £  IIfin  and  e  >  0  such  that  (4.4)  holds. 


(4.7) 


For  a  fixed  7,  checking  if  there  exists  II  £  IIfin  such  that  condition  (4.4)  holds  can  be  reformulated  as  a  convex 
feasibility  problem  with  LMI  constraints  (see  Lemma  4.2.3  below).  Current  techniques  take  advantage  of 
this  observation  to  solve  Problem  (4.7)  using  a  bisection  scheme;  see  [J96,  Bal95,  SC93,  Hel95]. 

There  are  a  number  of  problems  associated  with  using  the  bisection  scheme  to  solve  Problem  (4.7).  First, 
upper  and  lower  bounds  on  the  optimal  value  7opt  need  to  be  determined  to  initialize  the  bisection;  such 
bounds  may  be  known  a  priori  or  may  have  to  be  determined.  The  quality  of  these  bounds  will  of  course 
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affect  the  efficiency  of  the  bisection  scheme  in  computing  7opt.  Moreover,  the  bisection  scheme  does  not  take 
advantage  of  the  fact  that  Problem  (4.7)  is  a  quasiconvex  optimization  problem  (see  for  example,  [BEFB94] 
and  the  references  therein). 

We  now  show  how  the  drawbacks  with  the  bisection  scheme  can  be  avoided  altogether,  by  reformulating 
Problem  (4.7)  as  a  Generalized  Eigenvalue  Minimization  Problem  or  GEVP.  A  GEVP  is  an  optimization 
problem  of  the  form 


Minimize:  A 

Subject  to:  A B(x)  -  A(x)  >  0,  B(x)  >  0,  C(x)  >  0. 

Here  x  E  Rp  is  the  optimization  variable,  and  A(x ),  B(x)  and  C(x)  are  symmetric  matrices  that  are  affine 
functions  of  xi  i.e., 

A(x)  =  A0  +  xiAi  H - h  xpApy  B(x)  =  B0  +  xxBi  + - h  xpBP)  C(x)  =  C0  +  x\C\  H - V  xpCpi 

where  At-,  B{  and  C{  are  given  symmetric  matrices.  GEVPs  are  quasiconvex  optimization  problems  based 
on  linear  matrix  inequalities,  and  can  be  solved  very  efficiently  using  standard  algorithms  (see  for  exam¬ 
ple,  [BEFB94,  BE93,  GN95]).  In  particular,  as  we  will  demonstrate  in  §4.4,  the  solution  of  Problem  (4.7)  as 
a  GEVP  leads  to  considerable  computational  savings  over  the  solution  via  a  bisection  scheme. 

The  following  restatement  of  the  positive-real  lemma,  taken  from  [Ran96],  plays  a  central  role  in  the 
reformulation. 

Lemma  4.2.2  Let  A  E  Rnxn,  B  E  Rnxm  and  M  =  MT  E  R(m+n)x(m+n);  with  A  having  no  eigenvalues 
on  the  imaginary  axis.  Then ,  the  following  statements  are  equivalent . 

1.  For  some  e  >  0, 


cp 

1 

1 

3 

* 

M 

'  (jwl  -  A)-1  B  ■ 

1  J 

1 

>  2eJ,  for  all  oj  E  R. 


2.  There  exists  a  symmetric  matrix  P  =  PJ  such  that 

AT  P  +  PA  PB 
BTP  0 


<  M. 


Given  7  >  0,  Lemma  4.2.2  then  enables  us  to  restate  the  condition  that  (4.4)  is  feasible  for  some  n  E  J3fin 
as  an  LMI  feasibility  condition. 

Lemma  4.2.3  Let  H($ )  has  the  state  space  realization  (A,  5,  C,  D )  with  A  having  no  eigenvalues  on  the 
imaginary  axis .  Let 


Ay/  By/C  0 

Bw  D 

'I  0  0' 

n  r,  n 

A- 

0  A  0 

0  0  Ay/ 

,  B  = 

B 

Bw 

,  C  = 

l - 

O  O  < 

O  O  ( 

O  ^  < 

1 _ 

D  = 


0 

D 

0 

I 


(4.8) 


E  = 


Cw  0 
0  Dw 


Then ,  given  7  >  0,  there  exist  some  n  E  IIfin  and  e  >  0  such  that  condition  (4>4)  holds  if  and  only  if  there 


exist  symmetric  matrices  P  =  PT ,  Q 1  =  Qj  and  Qo  =  Q^f  and 

M\  =  EtRhE- 


Ru  R12 

R^12  “^22 


G  fi  such  that 


AjyQi+QiAw  Q\Bw 

BwQ\  0 


>  0, 


(4.9a) 
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M2  ~  E  R22E  — 


AjyQ 2  T  Q2Aw  Q2Bw 


AtP  +  PA  PB 
BTP  0 


+ 


<7t 

Dt 


ByyQ2 

jMi 


0 


etr12e 
etrJ2e  -~m2 

7 


>  0, 

[  c  b  ]  <  0. 


(4.9b) 

(4.9c) 


Proof:  Consider  the  condition  that  given  7  >  0,  there  exist  II  E  Ilfin  and  e  >  0  such  that  condition  (4.4) 

ftn  R12 


holds,  i.e.,  there  exists 


-ft  12  —R22 


E  ^  such  that  with 


W(ju;)  = 


Cw{jvl  -  Aw)  lBw 

Dw 


we  have: 

For  some  e  >  0,  for  all  to  E  R  ,  W (jw)* R\\W (ju>)  >  2 el  and  W R22W (jut)  >  2 el.  (4.10a) 


For  some  e  >  0,  for  all  cj  E  R, 

yW(jcj)*  R\ !  W(Jlo)  W(juj y  R12W(ju) 

W(joj)*  Rj2W(ju)  -  -  W(juj)*  R22W(ju ) 
7 


’  H(jw) 

* 

I 

I 

<  -2 el. 


(4.10b) 


Using  Lemma  4.2.2,  it  is  easily  argued  that  condition  (4.10a)  is  equivalent  to  the  existence  of  Q\  =  Qf  and 
Q2  —  Q%  such  that 


and 


Mi  =  ET  RuE  ■ 


M2  —  etr22e  — 


AwQi+QiAw  QiBw 


ByyQl 


0 


Aw  Q2  +  Q2Aw  Q2BW 


btwq2 


0 


>0, 


>0, 


where  E  is  defined  in  (4.8);  moreover,  it  is  easily  verified  that  for  all  u>  €  R, 

=  W  (joj)*  R\\W  (ju>), 


and 


(ju;I  —  Aw)  lBw 

I 

* 

Mi 

CT? 

e 

l 

to* 

5= 

I. . -1 

(jul  -  Aw)~lBv/ 

I 

* 

m2 

(juil  —  Aw)  lBw 

I 

=  W(ju>)*  R22W(ju). 


Then,  with  A,  B,  C  and  D  as  given  by  (4.8),  condition  (4.10b)  can  be  rewritten  as: 
For  some  e  >  0,  for  all  w  G  R, 


(C(ju>l  -A)-1  B  +  bJ 


7M1  ETR12E 

1 

12^ 


etrT2e  -~m2 


(C(jul  -A)~lB  +  D}<  — 2e/. 


(4.11) 


Condition  (4.11),  using  Lemma  4.2.2,  is  equivalent  to  the  existence  of  P  =  PT  such  that 

[  C  D  }  <  0. 


ATP  +  PA  PB 
BtP  0 


+ 


CT 

bT 


7M1  ETRnE 
1 


ETR(2E  ~-m2 
1 


(4.12) 


D 


This  completes  the  proof. 

Lemma  4.2.3  immediately  enables  the  reformulation  of  Problem  (4.7)  as  a  GEVP,  which  is  the  central 
result  of  this  chapter. 
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Theorem  6  Let  «opt  be  the  optimal  value  of  the  GEVP 


Minimize:  k 

Subject  to:  P  =  PT ,  Qx  =  Qf,  Q2  =  Qj,  X  =  XT  >  0,  7  =  YT  >  0, 


Rn  R\2 

.  Rl 2  -^22  J 


G  (2, 


Mi  =  £Tfln£- 
M  •;  =  ET  R22E  — 


^<3i  +  Qi-dn/ 


BwQ  l 


0 


A'wQi  +  Q2-4w  Q2BW 
B^Q2  0 


>0, 

>0, 


(4.13) 


■  atp  +  pa 

PB  ‘ 

■  CT  ■ 

X  EtR12E  ' 

btp 

0 

+ 

.  DT  . 

etrJ2e  -y 

'  C  D  ]  <  0, 


'  X 

0 

'  Ml 

0  ■ 

0 

m2  _ 

0 

Y 

>0, 


where  A,  B,  C,  D,  and  E  are  defined  in  (4-8).  Then,  the  optimal  value  of  Problem  (4-7)  is  1/K0pt- 

Proof:  Follows  directly  from  Lemma  4.2.3,  with  the  introduction  of  “slack”  variables  X  and  Y  and  the 
change  of  variable  k  =  I/7.  O 


4.3  Specified  structured  uncertainties 

With  the  preliminaries  in  §4.2,  we  now  consider  a  number  of  special  cases  for  A.  In  each  case,  the  corre¬ 
sponding  set  II  defining  the  IQCs  satisfies  assumption  (4.3),  so  that  the  results  of  §4.2  apply. 


4.3.1  Diagonal  nonlinearities 

Suppose  that 
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(4.14) 


Every  “diagonal”  A  with  an  L2  gain  that  does  not  exceed  one,  satisfies  every  IQC  from  IIDNL.  Note  that 
nDNL  is  already  described  by  a  finite  number  of  variables  so  that  nDNL  =  n]?^L  and  is  defined  by  (4.6), 
where  Aw ,  Bw  and  Cw  are  vacuous,  Dw  —  J,  and  Q  =  IIDNL. 

From  Theorem  6,  Problem  (4.7)  is  equivalent  to  the  GEVP 


Minimize:  k 

Subject  to:  P  =  PT,  X  =  XT  >  0,  Y  =  YT  >  0,  W  E  Rmxm  and  diagonal,  W  >  0, 
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with  1  //c0pt  being  the  optimal  lower  bound  on  7m.  This  GEVP  formulation  is  exactly  the  same  one  derived 
in  [EBFB92]  for  minimizing  the  Hoo  norm  of  H(s)  =  C(sl  -  A)~l B  +  D  over  diagonal  similarity  scalings 
(also  see  [GA94]). 
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4.3.2  Diagonal,  memoryless,  time-invariant,  sector-bounded  nonlinearities 

Suppose  that  D  —  0,  that  is,  H  is  strictly  proper,  and 
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The  set  of  uncertainties  satisfying  every  IQC  from  nPopov  contains  the  set  of  all  diagonal,  memoryless, 
time-invariant  nonlinearities,  with  the  diagonal  entries  in  sector  [—1, 1];  see  [DV75,  MR97].  These  are  often 
referred  to  as  diagonal  “Popov- type”  uncertainties. 

Note  that  the  elements  of  n£°pov  are  not  bounded  on  the  imaginary  axis.  But  a  simple  change  of 
variables  enables  us  to  address  this  problem.  (This  is  a  standard  technique,  used  to  derive  the  Popov 
criterion;  see  [DV75,  MR97].)  We  simply  define  H(s )  =  +  s)  —  (C  +  CA)(sI  —  A)~l B  +  CB,  and 

A  =  Aol/(l  +  s),  and  observe  that  the  stability  of  the  H- A  interconnection  is  equivalent  to  that  of  the 
H- A  interconnection.  Now,  A  satisfies  every  IQC  from 
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The  set  np°Pov  is  described  by  a  finite  number  of  variables  so  that  nPopov  =  nP°pov ,  and  is  defined  by  (4.6) 
with  Aw  —  — J,  Bw  —  Cw  —  Dw  —  7,  and 
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A,  r  6  Rmxm  and  diagonal,  A  >  0 


Then,  applying  Theorem  6  to  the  H- A  interconnection,  we  get  the  following  GEVP. 
Minimize:  k 


Subject  to:  P  —  PT ,  X  =  XT  >  0,  Y  =  YT  >  0,  A  and  T  are  diagonal,  A  >  0, 
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The  optimal  lower  bound  on  jm  is  given  by  l//c0pt- 


4.3.3  Parametric  uncertainties 

Suppose  A  is  a  constant  real  matrix  with  a  specified  block-diagonal  structure,  and  with  a  spectral  norm 
that  does  not  exceed  one:  A  =  diag(£>i, . . . ,  DM,dihx , . . .  ,d^I[N),  Di  G  R*,x*' ,  *  =  1, . . . ,  M,  di  G  R, 
i  =  1, .. .,  N,  with  <rmax(A)  <  1.  (Note  that  =  m.) 
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Then,  A  satisfies  every  IQC  from 
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(See  for  example  [Bal95,  MR97].) 

For  such  uncertainties,  Theorem  6  can  be  immediately  used  to  obtain  GEVPs  that  yield  a  guaranteed 
lower  bound  on  the  robust  stability  margin.  Let  V  denote  the  subset  of  real  matrices  that  lie  in  W,  i.e., 
V  =  Wf)Rmxm. 

Then,  a  subset  n£ar  of  npar,  described  by  a  finite  number  of  variables,  can  be  defined  as  follows.  Let 
W^l\  . . . ,  W(N~l)  be  strictly  proper,  stable  mxm  transfer  functions,  with  each  FF^  satisfying  W^\ju)  E  W 
for  every  wGR.  Let 
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Then,  a  subset  Ilj~ar  of  IIpar  described  by  a  finite  number  of  variables  is  given  by  (4.6),  where  (Aw,  Bw,  Cw) 
is  any  state  space  realization  of  [FF(x)(s)t  *  •  •  ^Ar”1^(5)T]T,  Dw  ~  I,  and 
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Thus,  the  problem  of  computing  lower  bounds  on  the  robust  stability  margin  of  systems  with  parametric 
uncertainties  can  be  efficiently  solved  as  a  GEVP. 

Note  that  the  choice  of  FF^  is  ad  Aoc,  and  the  value  of  /copt  will  certainly  depend  on  this  choice.  However, 
for  any  choice  of  W^\  the  inverse  of  the  optimal  value  /copt  obtained  from  GEVP  (4.13)  is  a  guaranteed 
lower  bound  on  the  robust  stability  margin  7m.  Moreover,  it  can  be  shown  (see  [CTB97a])  that  the  actual 
choice  of  the  is  immaterial,  provided  the  set  of  FF^s  is  chosen  to  be  “rich  enough”. 


4.3.4  Structured  dynamic  uncertainties 

Suppose  A  is  a  dynamic  block-structured  uncertainty  with  an  L/2-gain  that  does  not  exceed  one  (i.e.,  it  is 
nonexpansive):  For  all  u>  E  R,  A  (jv)  —  diag(£>i, . . . ,  Dm,  d\Itx , . . . ,  gJjvZ^),  Di  E  CfciXfc‘,  i  —  1 
d{  E  C,  %  —  1, . . .,  TV,  with  <rmBiX(A(juj))  <  1.  (Note  that  ^  k{  -f  =  m.) 

Then,  A  satisfies  every  IQC  from 
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where  W  is  defined  in  (4.16)  (see  for  example  [Bal95,  MR97]).  Similarly  to  the  development  in  §4.3.3, 
Rfin1  c  nLTI  can  be  described  by  a  finite  number  of  variables.  Let  . . .,  W^N  x)  be  strictly  proper, 

stable  mxm  transfer  functions,  with  each  FF^  satisfying  W^\jco)  E  W  for  every  wER.  Then,  a  subset 
II^1  of  nLTI  described  by  a  finite  number  of  variables  is  given  by  (4.6),  where  (Aw,  Cw)  is  any  state 

space  realization  of  [FF(x)(s)t  •  •  •  FF(n~x)(s)t]T,  Dw  =  7,  and 
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Thus,  the  problem  of  computing  lower  bounds  on  the  robust  stability  margin  of  systems  with  structured 
dynamic  uncertainties  can  be  efficiently  solved  as  a  GEVP. 
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4.4  A  numerical  example 


We  present  an  application  of  the  results  of  this  chapter  on  a  simple  example.  Consider  an  instance  of  the 
H- A  interconnection  system  with 


H(s) 


0.2  -1.5 

s2  +  0.1s  +  0.7  s2  +  0.1s  4-  0.7 

s  —7.5  s 

s2  +  0.1s  +  0.7  s2  +  0.1s -f  0.7 

0  0 


-s2  +  0.9s  -0.2 
s3  +  0.4s2  +  0.73s  +  0.21 

10s2  +  3s  +  3.5 
s3  +  0.4s2  +  0.73s +  0.21 
-2 

s  +  0.3 


With  A  assumed  to  be  diagonal  in  addition  to  satisfying  various  IQCs,  we  now  demonstrate  that  significant 
computational  savings  accrue  when  the  lower  bound  on  the  robust  stability  margin  is  computed  using  the 
GEVP  formulation  from  Theorem  6,  as  compared  to  a  bisection  scheme. 

In  implementing  a  bisection  scheme  to  solve  Problem  (4.7),  we  used  k  =  1/j  as  the  optimization  variable. 
Upper  and  lower  bounds  on  the  optimal  value  Kopt  that  are  required  to  initialize  the  bisection  can  be 
computed  using  different  methods;  and  the  performance  of  the  bisection  scheme  can  be  made  arbitrarily 
poor  by  choosing  the  bounds  to  be  far  enough  apart.  We  avoided  introducing  any  such  bias  against  the 
bisection  scheme  as  follows.  In  all  cases  that  we  consider,  A  satisfies  the  IQC  with  II  =  diag(i,  — /),  and 
therefore  ||i7||oo  is  an  upper  bound  on  /copt;  this  can  be  computed  very  efficiently  using  the  algorithms 
in  [BB90].  A  lower  bound  on  Acopt  is  simply  zero.  The  upper  bound  can  also  be  readily  incorporated  into 
the  GEVP  (4.13).  We  denote  the  GEVP  with  this  additional  linear  constraint  as  GEVPWB. 

Table  4.1  shows  a  comparison  of  the  performance  of  the  bisection  and  the  GEVP  schemes.  In  every  case, 
/copt  was  computed  to  an  relative  accuracy  of  1%.  In  the  case  of  diagonal  parametric  uncertainties,  nj^r 
was  given  by  (4.6),  (4.17)  and  (4.18),  with  the  following  choices:  Aw  =  diag(— 10,  —10,  —10),  Bw  —  Cw  — 


Dw  —  7,  and 
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022 
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In  the  diagonal  dynamic  uncertainties,  was  given  similarly,  with  the  only  difference  being  in  the 

definition  of  ft,  which  was  given  by  (4.19).  All  LMI  computations  were  performed  using  the  LMI  Toolbox  of 
MATLAB  [GN95],  and  computation  times  on  a  Sparc  20  are  reported  here2.  The  numerical  results  show  that 
GEVP  is  always  considerably  more  efficient  than  the  bisection  scheme.  In  addition,  this  example  suggests 
that  a  priori  knowledge  of  an  upper  bound  on  /copt  makes  little  difference  to  the  performance  of  the  GEVP. 


Uncertainty  Type 

1/ /^opt 

Bisection  (sec) 

GEVP  (sec) 

GEVPWB  (sec) 

General  nonlinear 

0.8200 

0.8000 

Dynamic 

EC 

20.3000 

18.9200 

Popov-type 

1.3264  x  10-* 

99.5700 

26.5300 

26.1200 

Parametric 

1.3278  x  10“^ 

51.8400 

19.8300 

19.1700 

Table  4.1:  A  comparison  of  the  bisection  and  GEVP  schemes.  All  uncertainties  are  assumed  to  be  diagonal 


4.5  Conclusion 

We  have  shown  that  a  guaranteed  lower  bound  on  the  robust  stability  margin  for  a  number  of  commonly 
encountered  uncertain  systems  can  bev  computed  via  generalized  eigenvalue  minimization.  Examples  show 
that  the  GEVP  reformulation  of  the  robust  stability  margin  lower  bound  computation  leads  to  considerable 
computational  savings.  The  results  presented  herein  also  apply  to  many  other  uncertain  systems,  besides 
the  special  cases  considered  in  §4.3;  see  for  example,  [MR97]  and  [TBL96]. 

2 Though  the  values  of  the  time  themselves  are  not  very  meaningful  as  they  depend  on  the  hardware  used,  the  ratio  of  the 
computation  time  of  the  bisection  scheme  to  the  GEVP  scheme  still  provides  a  meaningful  basis  for  comparison. 
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Chapter  5 


Gain-Scheduled  Controller  Synthesis 


We  present  new  algorithms  for  the  robust  stability  analysis  and  gain-scheduled  controller  synthesis  for 
linear  systems  affected  by  time- varying  parametric  uncertainties.  The  new  techniques  can  also  be  applied 
to  parameter-dependent  nonlinear  systems  with  real  rational  nonlinearities.  Sufficient  conditions  for 
robust  stability  as  well  as  conditions  for  the  existence  of  a  robustly  stabilizing  gain-scheduled  controller 
are  given  in  terms  of  a  finite  number  of  Linear  Matrix  Inequalities;  explicit  formulae  for  constructing 
robustly  stabilizing  gain-scheduled  controllers  are  given  in  terms  of  the  feasible  set  of  these  LMIs.  Our 
approach  is  proven  to  be  in  general  less  conservative  than  the  existing  methods  for  stability  analysis  and 
gain-scheduled  controller  synthesis  for  parameter-dependent  linear  systems  and  real  rational  nonlinear 
systems;  numerical  examples  are  presented  to  show  that  our  approach  offers  significant  improvement  in 
practice  as  well. 


5.1  Introduction 

Consider  the  parameter-dependent  system 

x  =  A{6(t))x  +  B(0(£))z/,  (5.1a) 

y  =  C  (0(t))x  +  D(0{i))ut  (5.1b) 

where  x{t)  E  Rn,  u(t)  E  Rn“  and  y(t)  E  Rny,  and  A,  B,  C  and  D  are  real-valued  rational  functions  of 
the  time- varying  parameter  vector  6{t)  —  [0i  (£)•■•  0m(t)]T  G  Rm,  which  for  all  t  >  0  is  restricted  to  lie 
in  a  polytope  0  C  Rm  containing  the  origin.  (When  0  is  not  a  polytope,  the  results  developed  herein 
can  still  be  applied  by  replacing  ©  with  some  polytope  0poiy  D  0.)  For  convenience,  from  now  on  we 
will  often  drop  the  dependence  of  6  on  t.  The  signals  u  and  y  have  the  interpretation  of  the  control  input 
and  the  measured  output  respectively.  We  assume  that  the  parameters  0(t)  are  unknown  a  priori,  but 
can  be  measured  in  real-time,  so  that  they  can  be  incorporated,  if  possible,  in  a  “gain-scheduled”  control 
strategy.  System  (5.1)  models  a  wide  variety  of  commonly-encountered  parameter-dependent  systems;  see, 
e.0..  [Doy82,  ZKSN92,  AGB95,  DG98]. 

We  consider  questions  of  stability  analysis  and  stabilizing  controller  synthesis  for  system  (5.1): 

(PI)  With  u  identically  zero,  does  the  state  x  of  system  (5.1)  satisfy  lim^oo  ®(0  =  0  for  every  initial 
condition  x(0)?  If  so,  we  say  the  system  is  “robustly  stable  over  0”. 

(P2)  Does  there  exist  a  control  law  u  =  K(y,  0,  t)  such  that  the  state  x  of  system  (5.1)  satisfies  lim^oo  x(t)  = 

0  for  every  initial  condition  z(0)?  If  so,  we  say  the  system  is  “robustly  stabilizable  over  0”. 

In  addition,  for  a  uncertainty  set  0,  we  define  the  robust  stability  margin  of  system  (5.1)  as 

crm  =  sup  {a  |  for  any  7  E  [0,  cr],  system  (5.1)  is  robustly  stable  over  7©  }  (5.2) 

and  the  robust  stabilizability  margin  as 

pm  —  sup  { p  |  for  any  7  E  [0,/?],  system  (5.1)  is  robustly  stabilizable  over  7©  }  .  (5.3) 

0  Joint  work  with  Fan  Wang,  Ph.D.,  School  of  Electrical  and  Computer  Engineering,  Purdue  University. 
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Let  us  first  consider  the  question  (PI),  that  of  robust  stability  over  0.  A  number  of  numerally  tractable 
sufficient  conditions  are  available  for  robust  stability,  depending  on  the  assumptions  on  the  function  A(0(f)). 
One  class  of  sufficient  conditions  is  based  on  the  notion  of  quadratic  stability:  The  system  x  —  A(0(f))£  is 
said  to  be  quadratically  stable  if  and  only  if  there  exists  a  single  quadratic  Lyapunov  function  V(x)  =  xT Px 
whose  derivative  is  negative  along  every  trajectory  of  the  system,  or  equivalently,  there  exists  P  =  PT  such 
that 

P  >  0,  PA(0)  +  A (6)tP  <  0  for  all  0(t)  G  0.  (5.4) 

For  the  simplest  case  when  A(0(f))  is  an  affine  function  of  9{t)  (this  is  the  so-called  “polytopic  sys¬ 
tem”  [BEFB94]),  a  necessary  and  sufficient  condition  for  quadratic  stability  can  be  given  in  terms  of  a  finite 
number  of  LMIs,  one  for  each  vertex  of  the  polytope  0  [HBT6,  BY89].  The  use  of  more  general  Lyapunov 
functions  offers  the  potential  for  improved  robust  stability  analysis.  One  such  technique  uses  parameter- 
dependent  Lyapunov  functions;  for  systems  with  slowly  time-varying  parameters,  stability  analysis  using 
parameter-dependent  Lyapunov  functions  usually  leads  to  less  conservative  robust  stability  conditions  than 
the  analysis  based  on  quadratic  Lyapunov  functions  [GAC96,  GN95]. 

The  approach  towards  answering  question  (PI),  for  systems  having  more  general  uncertainties  than  poly¬ 
topic  ones,  uses  a  linear  fractional  representation  (LFR)  for  parameter-dependent  systems  [BBB91,  KG96]. 
Here,  the  parameter-dependent  system  is  represented  as  an  LTI  system,  with  the  uncertain  parameters  ap¬ 
pearing  in  the  feedback  loop  as  a  diagonal  uncertainty  A  (see  Fig.  5.1).  Then,  scaling  matrices  can  be  used 
in  conjunction  with  the  small-gain  theorem  to  yield  sufficient  conditions  for  robust  stability  of  system  (5.1); 
see  for  example,  [BDG+91,  FTD91,  MR97].  In  a  special  case  when  the  uncertainties  are  time-invariant, 
the  most  sophisticated  (and  least  conservative)  technique  available  to  date  uses  the  framework  on  multi¬ 
plier  theory  [DV75,  HH93a,  SC93,  Bal94a],  or  equivalently  in  this  case,  the  framework  of  integral  quadratic 
constraints  [MR97];  these  approaches  correspond  to  searching  for  general  Lyapunov  functions  [Bal94b]. 


Figure  5.1:  LFR  of  parametric  uncertain  systems 

The  problem  of  controller  synthesis  (P2),  has  turned  out  to  be  considerably  harder.  While  the  problem 
of  robustly  stabilizing  constant  state- feedback  synthesis  for  polytopic  systems  as  well  as  LFR  systems  with 
real  constant  scalings  has  turned  out  to  be  convex,  no  convex  reformulations  are  known  for  the  problem  of 
even  constant  output  feedback  synthesis  for  even  polytopic  systems.  This  makes  the  general  output  feedback 
controller  synthesis  problem  very  hard  to  solve  numerically.  The  approach  that  holds  the  most  promise 
for  output  feedback  synthesis  appears  to  be  that  of  gain- scheduled  controller  synthesis1:  Since  in  many 
applications  the  parameters  6{t)  can  be  measured  [AGB95,  DG98,  SA92],  we  can  design  feedback  schemes 
that  are  themselves  parameter-dependent.  Designing  gain-scheduled  output  feedback  controllers  for  polytopic 
systems  or  LFR  systems,  using  a  single  quadratic  Lyapunov  function  can  be  reduced  to  finding  the  feasible 
set  of  a  finite  number  of  LMIs  [Bec93,  AGB95,  AG95,  Sch96a,  CG95].  Gain-scheduled  controller  synthesis 
for  polytopic  systems  using  parameter-dependent  Lyapunov  functions  is  also  studied  in  the  literature,  see 
for  example  [AA98,  WYPB94].  In  this  case  however,  one  usually  needs  to  grid  the  parameter  space  made 
up  of  the  uncertainties  and  their  first  derivatives  [AA98,  WYPB94];  thus,  in  a  sense,  one  needs  to  check  an 
infinite  number  of  LMIs.  Although  parameter  gridding  can  be  avoided  in  some  cases,  it  requires  either  more 
restrictive  assumptions  on  the  system  matrices  [AA98] ,  or  the  use  of  a  more  conservative  cover  for  the  set  of 
uncertainties  [YS97]. 

1  Our  use  of  the  term  “gain-scheduled”  refers  to  the  framework  of  LMI-based  gain-scheduling  techniques  [AA97,  EGS96, 
Bec93,  Wu95].  This  is  different  from  classical  gain-scheduling  controller  synthesis  techniques,  where  several  controllers  are 
designed  for  the  system  under  different  operating  conditions,  with  the  actual  control  law  “switching”  between  the  locally 
designed  controllers  using  some  “scheduling”  scheme  [SA90,  SA92]. 
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Our  approach  uses  the  framework  of  quadratic  (or  parameter-dependent  Lyapunov  function  based)  sta¬ 
bility  and  the  LFR  representation  as  do  [Bec93,  AGB95,  AG95].  However,  our  method  for  robust  stability 
analysis  is  less  conservative  than  the  conventional  methods  using  constant  scalings,  but  enjoys  the  same 
advantages: 

•  Our  method  results  in  a  finite  number  of  LMIs; 

•  Our  method  can  be  extended  to  the  synthesis  of  gain-scheduled  controllers; 

•  Our  method  is  based  on  quadratic  (or  parameter-dependent)  Lyapunov  functions,  and  therefore  can 
be  extended  to  robust  performance  analysis  and  synthesis. 

Indeed,  we  will  show  that  the  conventional  constant  scaling  method  can  be  viewed  as  a  special  case  in  our 
approach. 

Our  approach  can  be  interpreted  as  combining  vertex-type  quadratic  stability  results  for  polytopic  systems 
with  conventional  scaling  techniques;  thus  our  approach  can  effectively  take  advantage  of  the  knowledge  of 
polytopic  covers  that  describe  the  uncertainties  more  accurately  than  conventional  norm  bounds.  In  addition, 
we  will  demonstrate  that  even  when  only  a  norm-bound  condition  on  the  uncertainties  (or  equivalently,  only 
a  hypercube  cover)  is  available,  our  approach  enables  the  use  of  unstructured  scalings,  as  opposed  to  the 
usual  structured  scaling  techniques.  As  a  consequence,  our  robust  stability  analysis  conditions  are  always  less 
conservative  than  the  stability  analysis  using  structured  scalings.  Perhaps  more  significantly,  our  approach 
also  readily  leads  to  tractable  LMI  conditions  for  the  existence  of  a  gain-scheduled  output  feedback  controller. 
In  addition,  the  controller  designed  in  our  approach  can  be  easily  implemented  in  real-time. 

The  organization  of  this  chapter  is  as  follows.  In  Section  5.2,  we  outline  the  improved  stability  criterion 
for  parameter-dependent  systems  derived  using  the  LFR  framework.  We  extend  this  robust  stability  analysis 
technique  to  solve  the  problem  of  gain-scheduled  output  feedback  controller  synthesis  in  Section  5.3.  In  Sec¬ 
tion  5.4,  we  demonstrate  through  numerical  examples  that  the  new  approach  offers  significant  improvement 
over  existing  constant  scaling  techniques. 

5.2  Robustness  analysis  using  Lyapunov  functions 

5.2.1  Quadratic  stability  analysis 

Consider  the  state-trajectories  of  the  system  (5.1)  with  u  identically  zero: 

x  =  A  (6{t))x.  (5.5) 

Since  A(6(t))  is  a  real- valued  rational  function  of  6{t ),  we  have 

A (0(t))  =  A  +  B,A(0(t))(I  -  B„A(0(t)))-1Cp 

for  some  appropriate  matrices2  A,  Bg,  Cp  and  Dpq.  Then,  an  equivalent  linear-fractional  representa- 
tion  [BBB91,  EGS96,  KG96]  of  the  autonomous  system  (5.5)  is  given  by 

x  =  Ax  +  Bqq ,  p  =  Cpx  +  Dpqq,  q  =  A(0)p,  A(0)  =  diag(0i/5l ,  •  • . , 0mISin),  (5.6) 

where  x  £  Rn,  q  £  Rd,  p  £  Rd  and  A,  Bq ,  Cpy  Dpq  are  real  matrices  of  appropriate  sizes,  with  A  being 
Hurwitz,  i.e.,  with  all  its  eigenvalues  having  negative  real  parts.  The  quantity  max($i ,  •  •  • ,  sm)  will  be  termed 
the  LFR  degree  of  system  (5.6). 

Define 

A  =  {A(*)  |*(t)ee}.  (5.7) 

Obviously  A  is  a  poly  tope  as  well.  Let  A  j,  i  =  1, . . . ,  r  be  the  vertices  of  A.  The  following  theorem  gives  a 
sufficient  condition  for  the  system  (5.6)  to  be  quadratically  stable. 

2Here  we  assume  the  LFR  is  well-posed,  i.e.,  ,  det (I  —  DpqA(8(t)))  ^  0,  V0(t)  E  0. 
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Theorem  7  System  (5.6)  is  quadratically  stable  if  there  exists  P  £  Rnxn  with  P  =  PT  > 
ever^  A  £  A,  Mere  exist  GA  £  Cnxd  and  H a  G  Cdxd  satisfying 

f  PA  +  ATP  +  GaC^  +  CjGA*  P(59A)  +  Ga(^,9  A)  —  GA  +  CprPA* 

.  (BqA)T P  +  (DpqA)TGA*  -  GA*  +  #  AGP  HA(DpqA)  +  (Dpq A)T HA*  -HA-  HA * 

Moreover ,  V(rp)  —  Pip  is  a  Lyapunov  function  that  proves  the  quadratic  stability  of  system  (5.6). 

Proof:  Suppose  there  exist  P  =  PT  >  0,  Ga  G  Cdxd  and  ffA  £  Cdxd  satisfying  (5.8)  for  all  A  £  A. 
Consider  system  (5.6)  for  some  A  £  A.  The  equations  governing  the  system  can  be  rewritten  as 

x  =  Ax+(BqA)p,  (5.9a) 

p  =  Cpx  +  (Dpq  A)p.  (5.9b) 

Now,  for  any  Ga  G  Cdx<i  and  HA  £  Cdxd,  we  have 

xTGAp  —  xTGACpx  +  xTGA(DpqA)p, 
pTHAp  =  pTHACpx  +  pT  HA(Dpq  A)py 


0  such  that  for 
]  <  0.  (5.8) 


or  equivalently 
i  T 


x 

.  P  . 


GACp  +  CjGA*  GA{DpqA)  —  Ga  +  Cj  Ha* 

L  (DpqA)TGA*  -  Ga*  +  HaCp  HA(Dpq A)  +  {DpqA? HA*  —  HA  —  HA' 


Then,  we  have 
d 


dt 


(x(typx(t))  = 


1  T 


'  PA  +  ATP  P(5?A) 
(BqA)TP  0 


PA  +  ATP  P(Bq A)  1  [  x 

L  (P?A)TP  0  J  [  P 

GACP  +  Cj  Ga* 

L  (DpqA)TGA*  -  Ga*  +  # aGp  HA(DpqA)  +  ( DpqA)T HA *  -  -  #a* 


+ 


£ 

.  P  . 


Ga(£P9A)~Ga  +  CJPV 


=  0.  (5.10) 


<0. 


(This  is  simply  an  application  of  the  5-procedure;  see,  e.g.,  [BEFB94]  and  the  references  therein.)  □ 

Theorem  7  implies  that  the  quadratic  stability  of  system  (5.6)  can  be  established  by  checking  condi¬ 
tion  (5.8)  for  all  A  in  the  polytope  (5.7).  With  no  restrictions  on  Ga  and  HA — these  matrices  may  depend 
on  A — this  entails  verifying  infinite  number  of  matrix  inequalities.  This  issue  can  be  addressed  by  simply 
restricting  GA  and  HA  to  be  of  special  forms  such  that  the  left  hand  side  of  inequalities  (5.8)  is  convex  in  A. 
It  is  then  sufficient  to  check  that  inequality  (5.8)  holds  for  A,*,  i—  1, . . . ,  r,  the  vertices  of  the  polytope  (5.7). 
One  such  choice  for  Ga  and  HA  is  described  in  the  following  Corollary;  this  choice  is  interesting  in  that  it 
can  be  interpreted  as  an  “unstructured  scaling”  technique. 


Corollary  2  System  (5.6)  is  quadratically  stable  if  there  exist  P  =  PT  >  0  and  M  =  MT  >  0  such  that 


atp  +  pa  +  ctmcp 

BTq<iP  +  DpqiMCp 


PBqj  +  CjMDpq<i 
-M  +  D?qtiMD, 


J 


<0, 


1  •  •  •  r, 


(5.11) 


where  Bq>i  =  Bq A,-  and  £>p?|i  =  DpqAi. 

Proof:  Condition  (5.8),  with  Ga  =  Gj M/2  and  HA  —  ((DpqA)T+I)M/2,  reduces  to  (5.11).  The  conclusion 
of  the  corollary  then  follows  from  Theorem  7.  □ 
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Remark  5.2.1  Corollary  2  can  be  viewed  as  an  extension  of  the  well-known  structured  scaling  methods  for 
robustness  analysis.  Consider  the  special  case  when  ©  =  [— J,y]m  with  7  >  0,  i.e.,  when  it  is  a  hypercube. 
In  this  case ,  the  structured  scaling  techniques  [ EBFB92 ,  GA9f]  can  be  shown  to  be  equivalent  to  condi¬ 
tion  (5.11),  with  the  additional  restriction  that  M  =  MT  >  0  has  such  a  structure  that  it  commutes  with 
A.  (In  our  condition  (5.11),  M  has  no  other  constraints  other  than  being  positive  definite.)  More  signif¬ 
icantly,  our  approach  can  also  effectively  take  advantage  of  the  knowledge  of  polytopic  covers  that  describe 
the  uncertainties  more  accurately  than  conventional  norm  bounds. 

While  the  quadratic  stability  condition  (5.11)  is  less  conservative  than  the  conventional  structured  scaling 
methods,  this  comes  at  the  expense  of  an  increased  number  of  optimization  variables ,  owing  to  M  being 
unstructured.  In  addition,  the  number  of  LMIs  in  our  condition  (5.11)  equals  r,  the  number  of  vertices  of 
A.  This  reflects  the  added  price  to  pay  for  the  improvement  in  the  robustness  analysis  [ AGB95 ,  BEFB94]. 


Other  special  cases  for  Ga  and  Ha  are  listed  below: 


1.  Let  Ga  —  G  and  Ha  —  H  be  any  unstructured  real  constant  matrices.  Then  (5.8)  is  feasible  if 


PA  +  ATP  +  GCP  +  Cp  GT  PBq,i  +  GDpqii  -G  +  Cj HT 
BTq>iP  +  DTpq  iGT  -GT  +  HCP  H Dpqii  +  Djq-HT  -  H  -  HT  \ 


<0,  i  =  1, 


(5.12) 


where  Bqii  =  Bt A,-  and  DPJi,-  =  DpqAi. 

2.  Let  Ga  =  Cj M/2  and  Ha  =  (( DpqA)T  +  I)M/2  4-  ATS*t  with  A  =  AT ,  M  =  MT  >  0  being  a  real 
constant  matrix  and  S  =  —S*,  and  with  both  M  and  S  commuting  with  A.  Then  (5.8)  is  feasible  if 


ATP  +  PA  +  CjMCp  PBqA  +  CjMDpqA  +  CjSA 


ATBjP  +  ATDjqMCp  -  ATSCP 


—  M  +  AT  DjqMDpqA 
+ATDjqSA  -  ATSDpqA 


<0. 


(5.13) 


If  5  =  —S'1'  is  real  and  skew-symmetric,  (5.13)  yields  the  stability  criterion  derived  in  [EGS96],  which 
is  also  the  stability  criterion  for  systems  affected  by  time-varying  real  uncertainties,  obtained  in  the 
IQC  framework  [MR97].  If  S  =  jN  with  N  =  N1  being  real  and  symmetric,  (5.13)  gives  the  constant¬ 
scaling  version  of  the  the  stability  criterion  from  real-/*  analysis  [FTD91]. 

3.  Consider  the  special  case  when  Dpq  —  0.  Let  Ga  =  (QCP)T / 2  and  Ha  —  (25A  +  Q)T / 2,  where 
Q  =  QT  and  S  are  real  matrices.  Then  (5.8)  is  feasible  if 


'  ATP  +  PA  +  Cj  QCp  PBqti  +  CJ Si 

B^P  +  SfCp  -( Q  +  Si+S? ) 


<  0,  i  =  1 . .  .r, 


(5.14) 


where  Si  =  SA{.  Condition  (5.14)  is  sufficient  and  necessary  for  the  quadratic  stability  of  the  system 
x  =  (A  +  BqA(0)Cp)  x  over  0,  see  [MR97].  Also  note  that  in  (5.14),  P  is  not  necessary  to  be  positive 
definite.  However,  since  we  are  interested  in  the  quadratic  stability,  we  require  P  >  0  in  this  chapter. 
Indeed  in  our  case,  we  can  always  define  Si  =  —Q  =  I  without  arising  more  conservatism  (See 
Section  5.6). 


For  another  special  case  when  the  LFR  degree  of  system  (5.6)  is  one,  further  reduction  in  the  conservatism 
of  condition  (5.11)  is  possible.  Here,  let  Ga  =  Cj Ma/2  and  Ha  =  ((Dpg  A)T  +  /)Ma/2,  where  Ma  depends 
on  A.  Then,  (5.8)  is  equivalent  to 


AtP  +  PA  +  CJMaCp  P{Bq  A)  +  Cj  MA(DpqA) 

{BqA)TP  +  (L»P9A)tMaGp  -Ma  +  (£>p?A)tMa(£>p?A) 


<0,  A€  Co{Aj,...,AP}. 


(5.15) 


Since  Ma  is  a  variable  depending  on  A,  condition  (5.15)  is  less  conservative  than  condition  (5.11).  While 
condition  (5.15)  is  not  tractable  in  general  as  it  includes  infinitely  many  inequalities,  for  the  special  case 
when  the  LFR  degree  of  system  (5.6)  is  one,  condition  (5.15)  is  equivalent  to  checking  a  finite  number  of 
LMIs,  as  the  following  shows. 
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Corollary  3  Suppose  the  LFR  degree  of  system  (5.6)  is  one.  If  there  exist  real  positive  matrices  P  =  PT  >  0 
and  M{  =  Mj  >  0  such  that 


AT  P  +  PA  +  Cj  M{Cp  PBq<i  +  Cj  MiDpq<i 
BTqiP  +  DpqiMiCp  - Mi  +  DjqiiMiDpqii 


<0, 


i  =  1, ...  ,r, 


(5.16) 


where  Bq>i  =  Bq  A,-  and  Dpqj  —  DpqAi,  A ;  is  a  vertex  of  the  polytope  (5.7),  then  the  system  is  quadratically 
stable . 


Proof:  Inequality  (5.16)  implies  that  there  exists  a  quadratic  Lyapunov  function  V(tp)  =  ipT  Pip,  such  that 
P  >  0  and 


P{A  +  BqAi{I  -  DpqAi)~1Cp)  +  {A  +  BqAi(I  -  DpqAi)~1Cp)T  P  <  0,  i=l,...,r. 

(This  follows  from  an  argument  exactly  along  the  line  of  the  proof  of  Lemma  7.)  Now,  since  the  LFR  degree 
of  system  (5.5)  is  one,  it  turns  out  (see  [BY89])  that 

Co  {A  +  Bq Af(7  —  DpqAi)  1CP  \  i  =  1, . . . ,  r  } 

=  {A  +  BqA(I  -  DpqA)~lCp  |  A  E  Co{Au . . . ,  Ar}  }  . 

Therefore, 

P(A  +  BqA(I  -  Dp.Ay'Cp)  +  (A  +  BqA(I  -  DpqA)~1Cp)T P  <  0, 

for  any  A  E  Co{Ai, . . . ,  Ar},  and  system  (5.5)  is  quadratically  stable.  □ 

Condition  (5.16)  is  clearly  less  stringent  than  condition  (5.11),  as  it  allows  for  different  scaling  matrices 
Mi  for  different  vertices.  We  will  therefore  refer  to  the  application  of  Corollary  3  as  a  vertex-dependent 
scaling  method  or  simply  “vertex  scaling” . 

5,2.2  Robustness  analysis  using  parameter-dependent  Lyapunov  functions 

In  Section  5.2.1,  the  robustness  analysis  is  based  on  a  single  quadratic  Lyapunov  function.  This  approach 
can  be  easily  applied  in  the  robust  performance  analysis.  More  significantly,  this  approach  leads  to  convex 
conditions  in  solving  synthesis  problems,  which  will  be  shown  in  Section  5.3. 

If  system  (5.5)  is  affinely  parameter-dependent  or  polytope  type  parameter  uncertain  systems,  and  if  the 
time  varying  rate  of  the  uncertainty  8  is  bounded  and  lies  in  the  set  $  (specially  $  =  {0}  when  8  is  a  real 
constant  uncertainty),  [GAC96]  shows  that  the  quadratic  Lyapunov  function  method  can  be  extended  by 
using  parameter- dependent  Lyapunov  functions:  The  system  x  —  A (8)x  is  stable  if  there  exists  a  parameter- 
dependent  Lyapunov  function  V(x)  =  xT P(8)x  such  that  for  all  8(t)  E  0, 

P(9)  >  0,  P(0)  +  P(6) A(0)  +  A (e)TP(6)  <  0.  (5.17) 

Since  the  knowledge  of  the  time  varying  rate  of  the  uncertainty  is  incorporated  in  the  analysis,  Condi¬ 
tion  (5.17)  is  evidently  less  conservative  than  condition  (5.4).  However,  condition  (5.17)  consists  of  an 
infinite  number  of  inequalities,  even  in  the  simple  case  when  A(0)  and  P(8)  are  restricted  to  be  affine  func¬ 
tions  of  8.  Multi-convexity  techniques  are  proposed  in  [GAC96,  GN95,  AT98]  in  order  to  derive  a  sufficient 
condition,  consisting  of  a  finite  number  of  LMIs,  for  (5.17)  to  hold. 

Robust  stability  condition  (5.17)  has  been  applied  to  design  gain-scheduled  controllers,  using  multi¬ 
convexity  techniques  [AA98,  AT98],  or  using  a  more  conservative  cover  of  the  set  of  uncertainties  [YS97]. 
The  use  of  parameter-dependent  Lyapunov  function  to  solve  the  problems  at  hand,  i.e.,  when  the  state  space 
matrices  are  real- valued  rational  functions  of  8{t ),  remains  essentially  unexplored. 

Our  approach  is  combining  the  polytope  type  system  analysis  method  and  conventional  constant  scaling 
techniques  to  solve  the  robustness  problem  of  LFR  uncertain  systems.  Following  the  same  line  as  Theo¬ 
rem  7,  we  derive  a  sufficient  condition  for  robust  stability  using  parameter  dependent  Lyapunov  functions;  in 
addition,  the  associated  controller  synthesis  problem  can  also  be  reformulated  as  a  convex  optimization  prob¬ 
lem.  The  stability  condition  using  parameter  dependent  Lyapunov  functions  is  summarized  in  the  following 
corollary. 
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Corollary  4  Let  0*  =  [0,i  •  •  i  =  be  the  vertices  of  0  and  A*  =  A(0t).  Let  = 

[^jbi  •  •  •  4>jfcm]T,  k  =  1, . . . ,  v  be  the  vertices  of  System  (5.6)  is  stable  for  all  9  satisfying  (0,  0)  E  ®  x  if 
there  exist  Qj  —  Qj  E  Rnxn  and  M  —  MT  >  0  such  that 


En  ,ik  E\2  ,i 
L  En ,i  J 


<0  and  Qo +  ^2&ijQj  >  0,  i=l,...,r,  k  =  1 . i 

j=i 


(5.18) 


where 


Eu, ik  =  A  I  Qo  +  ^ Qij Qj  I  +  J  Qo  +  53®* jQj  1  AT  +  BqjMBjj  -  ^2$kjQj, 
\  i=1  /  \  j-1  J  i-1 

En,i  —  ^<2o  +  53 QtjQil  Cj  +  Bq,iM Djiit 

E22,i  =  —M  +  Dpq,iM Dpg  it 

and  Eq  i  ^  5^Aj,  Epq }i  =  Z^p^Aj;  i  —  1 . , . r }  k  —  1  ♦  •  *v. 


Proof:  It  is  easy  to  establish  using  routine  matrix  algebra  that  if  conditions  (5.18)  hold  for  all  the  vertices 
(0i,  <£,*),  they  also  hold  for  any  uncertainty  0  with  (0,0)  E  ®  x  4>.  Following  the  same  line  as  the  proof  of 
Theorem  7,  it  can  be  shown  that  the  affinely  parameter- depen  dent  Lyapunov  function 


V(x)  =  xT 


Qo  +  9i(t)Qi 


i=l 


-1 


X 


provides  a  guarantee  for  the  stability  of  system  (5.6)  for  all  0  satisfying  (0,0)  E  ®  x  □ 

When  Qi  —  0,z  =  1  condition  (5.18)  reduces  to  the  robust  stability  conditions  based  on  a 

single  quadratic  Lyapunov  function,  given  in  Corollary  2,  where  the  information  on  the  rate  of  variation 
of  the  uncertainty  is  not  incorporated  into  the  stability  analysis.  Thus  Corollary  4  offers  the  potential  for 
an  improved  stability  analysis  when  information  on  the  rate  of  variation  of  the  uncertainty  is  available. 
However,  this  comes  with  the  added  price  that  an  LMI  needs  to  be  checked  at  every  vertex  of  0  x  $. 

If  the  set  0  x  $  is  symmetric  around  the  origin,  i.e.,  ,  (0, 0)  E  0  x  4?  implies  (—0,  -0)  E  0x$,  it  can  be 
verified  that  if  condition  (5.18)  is  feasible  for  some  Q;,  then  the  system  must  be  quadratically  stable,  i.e.,  , 
Q{  —  0,i  =  1,2, . . ..  Therefore  in  this  case  Corollary  4  offers  no  improvement  over  quadratically  stability 
condition.  However,  for  many  cases  when  set  of  uncertainties  is  not  symmetric  around  the  origin,  Corollary  4 
can  be  strictly  less  conservative  than  the  quadratic  stability  condition  (see  the  numerical  example). 

Note  that  Corollary  4  offers  a  direct  approach  for  the  use  of  parameter-dependent  Lyapunov  functions  in 
the  analysis  of  systems  that  exhibit  a  rational  dependence  on  the  parameters.  This  in  contrast  with  indirect 
techniques  such  as  using  a  (conservative)  polytopic  cover  for 

{(*,  9, ....  0i0;- ,  0m0m)|0  G  0, 0  €  i  <  j} 
as  in  [GN95,  YS97],  or  using  a  conservative  multi-convexity  method  [AA98,  GAC96,  AT98]. 


5.3  Gain-scheduled  output  feedback  synthesis 

We  next  consider  the  problem  of  designing  a  gain-scheduled  output  feedback  control  strategy  u  —  K(y,  9(t)) 
such  that  system  (5.1)  is  robustly  stable.  In  particular,  we  show  that  the  sufficient  condition  for  robust 
stability  that  we  stated  in  Corollary  2  and  Corollary  4  for  system  (5.5)  can  be  directly  extended  to  designing 
a  gain-scheduled  controller  K(y,6(t))  that  is  guaranteed  to  stabilize  system  (5.1).  As  noted  in  Section  5.2, 
our  analysis  technique  guarantees  a  larger  stability  margin  over  conventional  constant  structured  scaling 
methods;  therefore,  the  corresponding  gain-scheduled  controller  will  come  with  a  larger  guaranteed  closed- 
loop  stability  margin  as  well3. 

3 In  this  context,  we  cite  the  works  [SNB97,  Sch96b],  in  which  full  block  scalings  method  is  used  to  solve  gain- scheduled 
controller  synthesis  problems.  The  robust  stability  condition  using  full  block  scalings  is  less  conservative  than  condition  (5.11). 
However,  the  procedure  to  construct  controllers  using  full  block  scalings  method  is  numerically  delicate. 
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Consider  system  (5.1).  Since  A,  B,  C  and  D  are  real- valued  rational  functions  of  0,  we  have 

m  m\  =  \c,  Z}  +  [°JAm,-D”mr'lc'  'D-1  (5'19) 

for  some  appropriate  matrices  A,  Bq ,  BU)  Cp ,  Cy ,  Dyq)  Dyu ,  and  Dpu.  Then,  an  equivalent  linear- 

fractional  representation  of  system  (5.1)  is  described  by 


x  =  Ax  +  Bqq  +  Buu ,  p  =  C^x  +  £>p9g  +  Dpuu:  y  =  CyX  + 
?  =  A(0)p,  A(0)  =  diag(0i/5l, . 


(5.20) 


where  x  E  Rn,  q  E  Rd,  p  E  Rd,  u  G  Rn“  and  y  E  Rny.  We  will  henceforth  assume  that  Dyu  =  0  and 
Dy?  =  0.  The  former  is  a  standard  assumption  and  can  always  be  satisfied  via  loop  transformations,  while 
the  latter  is  a  technical  assumption  that  implies  that  there  is  no  uncertainty  in  the  measured  output. 

The  controller  that  we  will  design  consists  of  a  parameter-dependent  linear  system  with  unity  feedback 
(see  Fig.  5.2).  This,  while  incurring  no  loss  of  generality,  will  be  important  in  establishing  LMI  conditions 
for  the  existence  of  a  stabilizing  gain-scheduled  controller.  Thus,  the  gain-scheduled  controller  1C  is  described 
by  the  state  equations 

ik  =  AkAXk  +  Bk^y-V  BkA2v,  u  =  CkA^k  +  DkA^yA  DkA12Vy  (5.21) 

W  =  CkA2Xk  +  DkA21y  +  DkA22v,  v  =  w, 

where  xk(t)  G  Rn*,  v  E  Rrf  and  w  E  Rd. 


Figure  5.2:  Gain-scheduled  output  feedback  controller 

All  the  state-space  matrices  in  (5.21)  are  functions  of  the  time-varying  matrix  A (0(t));  hence  their 
subscript  A.  (Their  exact  dependence  on  A  will  become  clear  later.)  Then,  with  the  notation  - 


r  Ak  a 

BkAi 

BkA2 

JO 

II 

S 

> 

Dk  A„ 

Bk  A 12 

(5.22) 

CkA2 

Dk  a21 

57 


the  state  space  equations  governing  the  closed-loop  system  Vc\  are 


Xk 

w 

P 


=  Acl(0) 


Ccl(9) 


Xk 


Xk 


+.  Bc\{9) 


+  Dd(0) 


where 


M*)  = 

Bc\(9)  = 

Cci(9)  = 

Dd(0)  = 


A  0  ' 
0  0. 

0  Bq 
0  0 

0  0 
LCP  0 


+ 


+ 


+ 


m 


0  Bu  0 
/  0  0 


0  Bu  0 
7  0  0 


0  0  7 

0  Dpu  0 


w 

P 


Q(0) 

(1(9) 

(1(0) 


0  7 

Cy  0 

0  0 


0  0 
0  0 
7  0 


0  7 

Cy  0 
0  0 


0  0 
o  a 


p?  j 


+ 


0  0  7 

0  Dpu  0 


(1(0) 


0  0 
0  0 
7  0 


(5.23a) 

(5.23b) 

(5.23c) 

(5.23d) 


Next,  we  state  two  lemmas  that  play  an  important  role  in  the  subsequent  development. 


Lemma  5.3.1  (Elimination  Lemma  [BEFB94,  GA94])  Given  G  €  Rnxn,  U  G  Rnxp ,  V  G  Rnxq, 
there  exists  a  matrix  G  Rpxq  such  that 


G  +  imvJ  +VClTUT  >  0 


if  and  only  if 


UlGUL  >  0  and  Vj G\ \  >  0, 

where  U±.  and  V±  are  the  orthogonal  complements  of  U  and  V  respectively. 

Lemma  5.3.2  (Completion  Lemma  [Pac94])  Let  0  <  XT  =  X  G  Rnxn  and  0  <  Y  =  YT  G  Rnxn . 
There  exist  X2  G  Rnxr ,  X3  G  Rrxr ,  72  €  Rnxr  and  Y3  G  Rrxr  such  that 


X  X2 


X ?  X3 


>  0  and 


x  x2] 

1 

Y  Y2  ' 

£ 

I _ 

.  Y?  ^3  . 

if  and  only  if 


'  X 

In  ' 

>  0  and  rank 

'  X 

In  ‘ 

.  In 

Y 

Y 

<  n  +  r. 


5.3.1  Gain-scheduled  controller  design  using  quadratic  Lyapunov  function 

We  first  design  quadratically  stabilizing  gain-scheduled  output  feedback  controllers  by  applying  Corollary  2. 
The  following  theorem  provides  a  sufficient  condition  for  the  existence  of  a  full  order  robustly  stabilizing 
gain-scheduled  controller. 

Theorem  8  Consider  the  closed-loop  system  in  Fig.  5.2.  Lei  n*  =  n.  Then ,  given  y  >  0,  there  exist 
P  =  PT  >  0  and  M  —  MT  >  0  such  that  for  every  0(t)  £  yO,  there  exists  Q(0(t))  satisfying 


A*P  +  PAd  +  Cl  MCc\  PBC\  +  ClMDcX 
BlP  +  DlMCci  -M  +  DlMDcl 


<0, 


(5.24) 
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if  and  only  if  there  exist  R  G  R"xn  and  S  G  Rnxn 
inequalities  hold: 


L  G  Rdxd  and  J  G  Rdxd  suck  that  the  following  matrix 


Nr 

0 


Ns 

0 


-|T 


AR  +  RAt 
CPR 

RCp 

-J 

i - 

7  JBZi 

'  ATS  +  SA 

7  SBq>i 

ClL  ] 

yt>l<s 

-L 

7Dl.iL 

LCP 

'jLDpqj 

-L 

Nr  0 
0  I 


Ns  0 
0  I 


<0, 


<0, 


(5.25a) 


5  I 
I  R 


>0, 


L  I 
I  J 


>  0,  i  =  1, . .  ,,r. 


(5.25b) 


where  Bq>i  —  BqAi,  Dpqii  =  Dpq  Aj,  A  *•,  i  =  l,...,r  are  the  vertices  of  the  polytope  A,  Nr  and  Ns  are 
matrices  whose  columns  comprise  the  bases  of  the  null  spaces  of  [ B l  Dju]  and  [Cy  0]  respectively. 

Proof:  Since  9  G  7©,  we  have  A  G  7A.  Using  Schur  complements,  observe  that  condition  (5.24)  is 
equivalent  to 


Let 


Aq 


A^P  +  PAC, 

PBd 

cl 

BlP 

-M 

Dl 

Cd 

Dc\ 

A  0  ' 

0  0  : 

,  Bo  (9)  = 

.  r  0  Bq(9)  • 

'  1  0  0 

,  C0  = 

<  0. 


(5.26) 


D0{9)  = 


0  0 

L0  Dpq{9)  J 


£  = 


0  Bu  0 

J  0  0 


V 


pu 


0  0 

0  Dpu 


0 

I  ■ 

'  0 

0  ‘ 

,  c  = 

Cy 

0 

0 

0 

II 

0 

I 

0 

0 

where  Bq(8)  —  BqA{8)  and  Dpq{8)  =  DpqA(6)  affinely  depend  on  8 .  Then  using  (5.23),  inequality  (5.26) 
can  be  written  as 

X  -f  UtQ(8)V  4-  VtQ{0)tU  <  0, 


(5.27) 


where 


X 


BTp 


PB0 

cl 

-M 

Dl 

Do 

-M~ 

Co 

Partition  P,  P~l,  M  and  M-1  as 


U  =  [  BTP  0  Vju  ]  and  V  =  \  C  Vyq  0  ' 


P  - 


S  * 
*  * 


P~l  = 


R  k 

k  * 


M  = 


*  ★ 
★  L 


M-1  = 


*  * 
*  J 


Using  this  partitioning  of  P  and  M  and  the  elimination  Lemma  and  the  completion  Lemma,  it  is  straight 
forward  to  verify  that  inequality  (5.27)  is  feasible  for  some  Q(A((?))  if  and  only  if 


Nr  0 
0  I 


Ns  0 

0  I 


T 

'  AR  +  RAt 

RCJ 

(BqA)J  ] 

CPR 

-J 

(DpqA)J 

[  J(BqAf 

J  (  Dpq  A  )1' 

-J 

'  ATS  +  SA 
'/(BqA)TS  i 

S(Bq  A) 
-L 

CJL 

(DPgA)TL 

LCP 

L(Dpq  A) 

—L 

S  I 

I  R 

>0, 

- 1 

1 

h-H  ^5 

>  0- 

Nr  0 
0  I 


Ns  0 
0  I 


<  o, 


<0, 


(5.28a) 


(5.28b) 
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Note  that  the  left  hand  sides  of  (5.28a)  are  affine  in  A.  Therefore  conditions  (5.28a)  hold  if  and  only  if 
they  hold  for  each  vertex  of  jA.  Finally  it  is  easily  argued  that  if  (5.28)  is  feasible  with  nonstrict  inequality, 
it  is  also  feasible  with  strict  inequality.  Thus  we  get  condition  (5.25).  □ 

The  main  implication  of  Theorem  8  is  that  we  now  have  a  sufficient  condition  for  the  existence  of  a 
robustly  stabilizing  gain-scheduled  controller  for  system  (5.1).  In  contrast  with  the  gain-scheduled  controller 
designed  in  [AG95]  and  [EGS96],  there  are  no  structure  constraints  on  M  in  Theorem  8;  consequently,  even  in 
the  case  when  0  is  a  hypercube,  our  design  is  at  most  as  conservative  as  the  design  using  structured  scalings. 
Of  course,  as  with  the  stability  analysis,  our  design  can  also  directly  take  advantage  of  the  knowledge  of 
more  accurate  polytopic  covers  for  the  uncertainties. 

Remark  5.3.1  Note  that  since  the  gain-scheduled  controller  depends  on  the  uncertain  parameters  6{t),  the 
LFR  degree  of  the  closed  loop  system  is  always  greater  than  one.  Thus  we  may  not  use  vertex  scaling 
(Corollary  3)  in  designing  gain-scheduled  controllers.  However  for  general  output  feedback  synthesis  problems 
(see  [ACGB93]),  we  may  still  apply  Corollary  3  to  design  output  feedback  controllers  that  guarantee  larger 
closed-loop  stability  margins. 


A  direct  consequence  of  Theorem  8  is  that  a  lower  bound  of  the  robust  stabilizability  margin  pm  can  be 
computed  by  solving  the  following  Generalized  Eigenvalue  Minimization  Problem  (GEVP). 

Minimize:  k 


Subject  to: 
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Ns 
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0 
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'  AR  +  RAT 

RCJ 

Bqy{J 

CPR 

-X 

Bpq,i  J 

1 - 

to 

~TSHT 

-X 

'  ATS  +  SA 
BJ,S 

SBqti 

-Y 

Cj  L 

dLl 

L 

LCp 

BdDpq^i 

-Y 

0, 

'  L  I  ‘ 
I  J 

>0,  i- 

—  1  f* 

Nr  0 
0  I 


<0, 


Ns  0 
0  I 


<0, 


(5.29) 


X  <  kJ,  Y  <  kL 

where  Bqi  =  BAit  Dpq<i  =  DpqAi,  R,  S,  L,  and  J  are  optimization  variables,  pm  —  1/k  is  the  robustly 
stabilizability  margin. 

For  a  given  7  >  0,  we  have  thus  far  only  derived  conditions  for  the  existence  of  a  quadratically  stabilizing 
gain-scheduled  output  feedback  controller  over  7©.  We  now  describe  an  algorithm  for  explicitly  constructing 
a  family  of  gain-scheduled  output  feedback  controllers  that  are  guaranteed  to  stabilize  the  system  over  7© . 


Step  1.  Design  controllers  corresponding  to  each  vertex  of  the  polytope  7 A  . 

Let  (R,  S,  L,  J)  be  a  feasible  solution  to  (5.25).  With  S  >  R' -1,  define  P12  =  (S  —  R _1)1/2  and 


<9i2  =  -RP12,  and 


P  = 


P12 

I 


(5.30a) 


Then, 


p-1  = 


R  Q 12 

QL  1-PT2Q12 


Next,  with  M12  =  (L  —  J  1)1/2  and  N12  =  —JM\2,  define 


(5.30b) 


M  = 


I 

M 12 


M\2 

L 
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Then, 

i  _  r  /  -  m?2n12  n?2  i 

[  Nn  J  .  ' 

With  P,  M  and  M_1  defined  above,  for  each  A;,  i  =  the  LMI  (5.27)  must  be  feasible 

from  the  equivalence  between  (5.27)  and  (5.25).  By  solving  the  LMI  feasibility  problem  (5.27)  for 
fiA,  =  £2(Af(0)),  we  get  a  controller  ftA.  corresponding  to  the  vertex  A;. 

Step  2.  Design  the  gain- scheduled  controller . 

For  any  A(0(£))  £  7A,  solve  the  set  of  linear  equations  A(#(f))  =  X^=1  ai(t)jA{  to  get  a,(f).  Define 

r 

mm  =  E  a,'(<)7«A,.  (5.31) 

i=l 

Then,  (5.31)  gives  the  state  space  matrices  of  again-scheduled  controller  that  is  guaranteed  to  quadrat- 
ically  stabilize  the  system. 

Note  that  in  controller  (5.31),  every  system  matrix  of  the  controller  in  (5.22)  is  “scheduled”,  that  is, 
depends  on  9(t )  (unlike  with  [AGB95,  EGS96]  where  only  Bk2,  Dkl2  and  Dk22  are  scheduled). 


5.3.2  Gain-scheduled  controller  design  using  parameter-dependent  Lyapunov 
functions 

For  affinely  parameter-dependent  systems,  the  gain-scheduled  controller  design  based  on  a  single  quadratic 
Lyapunov  function  can  be  improved  by  using  parameter-dependent  Lyapunov  functions  [AA98].  In  this  sec¬ 
tion,  we  consider  the  use  of  parameter-dependent  Lyapunov  functions  for  designing  gain-scheduled  controllers 
for  the  more  general  parameter-dependent  systems  described  by  the  LFR  framework. 

Theorem  9  Consider  the  parameter-dependent  system  with  a  full  order  output  feedback  controller  in  Fig.  5.2, 
i.e.,  ,  rik  =  n.  Then  the  parameter-dependent  system  is  robustly  stabilizable  for  all 9  satisfying  (0, 6)  £  ©  x  $ 
if  there  exist  Rj  £  Rnxn  and  Sj  £  Rnxn,  L  £  Rdxd  and  J  £  Rdxd  such  that  the  following  matrix  inequalities 
hold: 

r  f  Ell  El  2  I  E\3  1  r  »r  i\  i 
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Ns  0 
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En 
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Pi  3 
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[~ElT 

"^1 

-j  _ 

Fn 

F\2 

P 13 

F?2 

-X 

P23 

N; 

~f$t 

—L  _ 

Nr  0 
0  / 


Ns  0 
0  I 


L  A(9(t))X 
XA  (9(t))  X 


(5.32a) 

(5.32b) 

(5.32c) 

(5.32d) 


R  —  R0  +  ^  ]  Oj  ( t)Rj ,  S  —  So  +  y  ]  9j  ( t)Sj , 

j=i  j= i 

m 

En=AR  +  RAt  -  Oj  (0#? , 

j=i 

Ei2  =  RCj,  Eis  —  Bq(9)J,  E23  =  Dpq(9)J, 

m 

Fu  =  AT5  +  5A  +  E hm. 

j  =  1 

Fi2  =  SBq ,  Fi3  =  CfL,  F23  =  DpqL. 

Bq(6)  =  BqA(0(t)),  Dpq{0)  —  DpqA(0(t))}  Nr  and  Ns  are  matrices  whose  columns  comprise  the  bases  of 
the  null  spaces  of  [Pj  and  [Cy  0]  respectively. 
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Note  that  conditions  (5.32)  are  linear  matrix  inequalities.  Therefore  we  only  need  to  check  the  feasibility 
of  these  LMIs  on  the  vertices  A,-  and  .  Moreover,  when  Rj  =  0  and  Sj  =  0,  j  =  1 , . . .  ,m,  conditions  (5.32) 
yield  the  quadratically  stabilizing  gain-scheduled  controller  synthesis  condition  (5.25);  this  corresponds  to 
the  situation  when  the  rate  of  variation  of  the  uncertainty  cannot  be  measured  in  real  time  or  is  unbounded. 
Conditions  (5.32)  offer  the  potential  of  improved  gain-scheduled  controller  design  when  information  on  the 
rate  of  variation  of  the  uncertainty  is  available. 

Proof:  Condition 


L  A  (9(t))X 
XA  (6(t))  X 


implies  L  >  AX  A.  Multiplying  the  first  inequality  in  (5.32b)  on  the  left  and  right  by  diag(7,  A,  I),  we  get 
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r  Fn 

f\2 

P 13 

-  T 

F\2 

-L 

F23 

i 

F23 

—L  . 

Ns  0 
0  I 


<0, 


(5.33) 


where  F\2  =  ^So  +  Xj  @j  (t)Sj  J  Bq(9)  and  F23  =  Dpq(6)T  L.  Therefore  (5.32b)  holds  for  all  ( 9 , 9)  G  ©  x  $0 

if  and  only  if  (5.33)  holds  for  all  (9,6)  £  0  x  $.  Using  a  similar  argument  as  the  one  in  the  proof  of 
Theorem  8,  it  can  be  checked  that 


[  Acl(9)TP(9 )  +  P(6)AC\(9)  +  Cc](9)TMCcl(6)  +  P(6)  P(9)Bcl(9)  +  Cc[(9)T M Dci(9) 
Bci(9)TP(9)  +  Dc](9)TMCcl(9)  -M  +  Dc](6)T  M  Dcl(6) 


<0, 


where 


P(0)  = 


S  -(S-R-1) 
-( S-R -1)  S-R-1 


S  =  S0 +  J2ei  (t)S:  -  R  =  Ro  +  9 j  (t)Rj , 

j= 1  i= 1 


and 


M 


I  M?2 
M\  2  L 


>0,  M12  =  (L-J~1)1'2,  n12  =  -jm12. 


Thus  the  system  is  robustly  stable  and  P(@)  defines  parameter-dependent  Lyapunov  functions  which 
guarantee  the  stability.  a 

We  now  present  an  algorithm  for  explicitly  constructing  a  family  of  gain-scheduled  output  feedback 
controllers  that  are  guaranteed  to  stabilize  the  system. 

Suppose  that  the  synthesis  conditions  (5.32)  are  feasible  for  some  matrix  variables  L,  J,  and  Rj,Sj , 

j  = 

Step  1.  For  a  uncertainty  measured  in  real  time ,  (0,0)  G  0  x  construct  P(0)  and  P(0)-1. 

Let 

m  m 

S  —  S*o  +  'y  ^  0j  (t ) Sj ,  R  =  Ro  +  y  ^  0j  (l)Rj  • 

j= 1  J= 1 

m  m 

j= 1  j=1 


Then 
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and 


P  = 


5  -(S-R-1) 
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M  = 
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>0, 
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where  Mi2  =  (L  —  J  1)1^2  and  A/12  =  —  JM12.  Thus 


1  _  A!  ^ 

"  [  (S-iT1)"1^  J  ’ 

and  _  m 

M~l  =  f  >0. 

A/l2  J 

Then 

•  [  5  -(S  +  R-'RR-1)  ' 

F  ~  [  -(S  +  R-'RR-1)  S  +  R~1RR~1  .  ' 

Since  conditions  (5.32)  are  feasible  with  L,  J,  and  Rj,Sj ,  j  =  it  can  be  checked  using  the 

Elimination  Lemma  5.3.1  that 

x(6, 6)  +  uTn(e) v  +  vTci(d)Tu  <  o,  (5.34) 


must  be  feasible  for  some  Cl(0),  where 


x(e,6) 


A%P  +  PAo  +  P  PB0  C0T 
B%P  -M  Dl 

Co  Do  -M-1 


0  0 

0  Dpq{0) 


Step  2 .  Design  the  gain- scheduled  controller . 

Solve  the  LMI  feasibility  problem  (5.34)  for  Q(0),  which  comprises  the  state-space  matrices  of  the 
gain-scheduled  controller  that  stabilizes  the  system.  Moreover,  V{x,6)  =  xT P(6)x  is  a  parameter- 
dependent  Lyapunov  function  that  guarantees  the  stability  of  the  closed  loop  system. 


Note  that  in  the  above  algorithm,  since  P{9)  is  not  an  affine  function  on  6 ,  solving  (5.34)  for  a  stabilizing 
gain-scheduled  controller  is  not  as  easy  as  designing  a  gain-scheduled  quadratic  stabilizing  controller  in 
Section  5.3.1  (where  £}(#)  is  simply  a  convex  combination  of  the  controllers  fli  that  each  corresponds  to 
a  vertex  of  A).  In  order  to  construct  the  gain-scheduled  stabilizing  controller  using  parameter-dependent 
Lyapunov  functions,  we  need  to  solve  the  LMI  feasibility  problem  (5.34)  in  real  time.  One  approach  is  to 
solve  LMI  feasibility  problem  (5.34)  numerically  using  an  LMI  solver  [GN95,  GDN95];  another  approach, 
which  requires  less  on  line  computation  time,  is  to  find  a  feasible  solution  of  (5.34)  analytically  (see  [GA94]). 


5.4  Numerical  Examples 

In  Section  5.2  and  Section  5.3,  we  observed  that  our  approach  is  in  general  less  conservative  than  structured 
scaling  methods.  We  now  illustrate  this  point  through  numerical  examples. 

5.4.1  Improved  robustness  analysis 

The  objective  of  the  first  example  is  to  demonstrate  that  our  approach  yields  significantly  better  results  for 
robust  stability  analysis,  as  compared  to  the  structured  constant  scaling  methods.  Consider  a  second  order 
deferential  equation  with  parametric  uncertainties 

x  -f  (1  -  r(t)  cos  (j)  +  r(t)  sin  (j)  +  0.5r(t)2  sin  2 <j))x  +  x  =  0,  (5.35) 

where  r(t)  is  a  bounded  uncertain  time-varying  parameter  and  <j>  is  a  (uncertain)  angle  lying  in  the  sector 
[0,  7t/4].  A  state-space  realization  of  (5.35)  is 

0  -1  1  [  x\ 

1  —  1  +  r(t)  cos  (j)  —  r(/)sin^  —  0.5r(t)2  sin  2</>  x2 
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Note  that  the  state  matrix  is  not  a  real  rational  function  on  the  uncertainties.  However,  with  a  simple 
change  of  variables  @i(t)  =  r(t)cos^  and  ^(0  =  r(t)sin<£,  we  obtain  the  following  LFR  with  A(t)  = 
diag(0i(<), 
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This  LFR  is  always  well-posed.  Define 

0  =  {(cos  (j>>  siiup)  |  <j>  G  [0,  7t/4]  U  [7 r,  57t/4]}. 

This  set  is  shown  shaded  in  Fig.  5.3.  Note  that  0  is  not  a  polytope;  we  therefore  use  its  polytopic  covers 
in  order  to  apply  the  results  of  Sections  5.2  and  5.3.  The  stability  margin  <rm  is  the  largest  a  such  that  the 
stability  of  the  system  (5.36)  can  be  guaranteed  for  any  r  £  [0,  <r]. 


*1 00 


Figure  5.3:  Uncertainty  set  (0 i(t),  02(t))  and  its  polytopic  cover 

We  will  compare  the  following  robust  stability  analysis  methods,  using  as  the  basis  for  comparison  the 
robust  stability  margin  that  they  can  guarantee  for  system  (5.36): 

1.  Hypercube  cover ,  diagonal  scaling  [ EBFB92 ,  BEFB94,  DPZ91].  This  is  equivalent  to  covering  0  by  a 
rectangle  EFGHE  (dotted  line). 

2.  Polytopic  cover ,  unstructured  scaling  ( Corollary  2)  This  can  be  interpreted  as  covering  0  by  the 
poly  tope  ABC  DA  (solid  line). 

3.  More  accurate  polytopic  cover ,  unstructured  scaling  ( Corollary  2).  This  can  be  interpreted  as  covering 
0  by  the  polytope  AEICGJ A  (dashed  line). 

4.  Vertex  scaling  (Corollary  3).  Note  that  the  LFR  degree  of  system  (5.36)  is  one,  and  therefore  Corol¬ 
lary  3  can  be  applied  with  both  polytopic  covers  ABC  DA  and  AEICGJ  A  for  0. 

In  this  example,  the  exact  stability  margin  turns  out  to  be  one.  The  lower  bounds  on  the  robust  stability 
margin  computed4  using  the  four  approaches  described  above  are  given  in  Table  5.1.  The  results  illustrate 

4 The  actual  calculation  was  performed  by  reformulating  the  lower  bound  calculation  problem  as  a  GEVP;  see  [BW98]. 
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the  observation  that  for  linear  systems  affected  by  time- varying  parameters,  the  approach  described  in  this 
chapter  offers  significant  improvement  for  robustness  analysis  over  the  traditional  structured  scaling  methods. 


Polytope 

No.  of  LMIs  in  (5.11) 

Constant  scaling 

Variable  scaling 

EFGHE 

1 

0.4874 

— 

ABCDA 

2 

0.8082 

AEICGJA 

3 

0.9024 

Table  5.1:  A  comparison  of  the  stability  analysis  by  using  structured  scaling  and  unstructured  scalings 


5.4.2  Improved  gain-scheduled  controller  synthesis 


We  have  seen  in  Section  5.4.1  that  our  approach  offers  significant  improvement  over  conventional  structured 
scaling  techniques  for  robustness  analysis.  We  now  demonstrate  that  similar  improvements  accrue  with 
gain-scheduled  controller  synthesis  as  well. 

Consider  the  system  in  Example  1  with  an  additional  control  input  u  and  a  measured  output  y .  The 
linear  fractional  representation  of  the  system  is 
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Table  5.2  shows  a  comparison  of  the  performance  of  different  synthesis  methods,  based  on  the  robust  stabi- 
lizability  margin  that  they  can  guarantee  using  quadratic  Lyapunov  functions  for  system  (5.37).  It  can  be 
seen  that  our  approach  using  unstructured  scalings  yields  significantly  improved  stabilizability  margin  than 
the  design  using  structured  scalings. 


Type  of  scaling 

Polytope 

No.  of  LMIs  in  (5.25a) 

Constant  scaling 

Diagonal 

EFGHE 

2 

0.9985 

Unstructured 

ABCDA 

4 

1.3646 

Unstructured 

AEICGJA 

6 

1.8609 

Table  5.2:  A  comparison  of  gain-scheduled  controller  synthesis  by  using  structured  scaling  and  unstructured 
scalings 


5.4.3  Improved  stability  analysis  with  parameter  dependent  Lyapunov  function 

In  this  example,  we  show  that  the  robust  stability  criterion  by  using  parameter-dependent  Lyapunov  functions 
(Corollary  4)  is  strictly  less  conservative  than  the  quadratic  stability  criterion  (Corollary  2). 
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Consider  the  system: 


’  «i  * 

'  0 

-1  ' 

[  21  1  +  [ 
^2  J  [ 

-1.1447 

-2.2358  ‘ 

.  ®2  . 

1 

-1 

2.5930 

1.7060 

1.0416  2.3899 

-0.5656  -3.3902 


*1 

*1 


+ 


0  0 

-1  0 


(5.38) 


q  =  Ap, 

where  A  =  diag(0i(£),  62(f)),  6i(t)  =  r(t)cos^  and  62(f)  =  r(f)sin</>,  <f>  is  an  uncertain  parameter  and  lies 
in  the  set  [0,  7t/4].  r(t)  is  a  bounded  time-varying  uncertain  parameter  and  satisfies  r(t)  E  [0,  r].  The  rate  of 
variation  of  r(t)  is  also  bounded  by  k ,  i.e.,  ,  |r(f)|  <  k.  With  different  k}  Fig.  5.4  shows  the  lower  bounds  of  r, 
under  which  the  robust  stability  of  the  system  can  be  guaranteed  by  using  parameter-dependent  Lyapunov 
functions.  The  results  show  that  the  information  of  the  bounds  on  the  rate  of  variation  of  the  uncertainties 
can  be  incorporated  in  the  robustness  analysis  to  reduce  the  conservatism. 

Similarly,  the  gain-scheduled  controller  design  using  parameter  dependent  Lyapunov  functions  is  also  less 
conservative  than  the  gain-scheduled  controller  design  using  a  single  quadratic  Lyapunov  function.  However, 
the  improvement  comes  with  the  cost  of  a  larger  number  of  LMIs  and  optimization  variables. 


Bounds  on  the  variation  of  the  uncertainty 

Figure  5.4:  Robust  stability  analysis  of  system  (5.38)  with  different  bounds  on  the  rate  of  variation  of  the 
uncertainty 


5.4.4  Robust  stability  analysis  of  a  nonlinear  system 

In  this  example,  we  show  that  the  approach  we  proposed  in  this  chapter  can  also  be  applied  to  solve  the 
stability  analysis  problems  of  nonlinear  systems  with  real  rational  nonlinearities.  Consider  an  autonomous 
nonlinear  system 
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The  linear  fractional  representation  of  this  second  order  nonlinear  system  is 
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=  A  p, 


where  A  =  diag(zi,Z2)  is  the  “uncertainty”.  We  study  the  local  stability  around  the  origin,  with  the 
approach  of  [EGS96]  by  using  a  quadratic  Lyapunov  function.  First,  we  assume  that  the  states  are  bounded, 
i.e.,  ,  |xt|  <  cr,  i—  1,2.  Then,  with  the  following  LMI  condition 


a* 
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p 


>0,  *=1,2, 


(5.41) 


where  P  is  from  the  quadratic  Lyapunov  function  V{rj>)  =  x/jt  P'lp,  which  guarantees  the  robust  stability  of 
system  (5.40)  when  |£t*|  <  cr,  i  =  1,  2,  it  can  be  shown  that  £p  =  {x\  xT Px  <  1}  is  an  invariant  set  (ellipsoid) 
around  the  origin  (see  [EGS96]  for  details). 

With  a  fixed  cr,  the  size  of  the  invariant  set  £p  can  be  maximized.  Here  with  cr  =  0.5,  we  maximize 
the  trace  of  P,  which  has  the  effect  of  maximizing  the  largest  sum  of  the  squared  semi-axis  lengths  of  the 
invariant  ellipsoid  £p. 

There  are  several  methods  to  search  for  the  quadratic  Lyapunov  function  V{$)  =  ipT Pip.  Our  conditions 
from  Theorem  7  make  use  of  unstructured  scalings  and  is  guaranteed  less  conservative  than  the  conventional 
method  using  diagonal  scalings.  In  Table  5.3,  we  list  the  largest  traces  of  P,  which  can  be  guaranteed  by 
conventional  method  using  diagonal  scalings,  Corollary  2,  and  Corollary  3  respectively. 


Quadratic  stability  criterion 

Largest  Tr(P) 

Conventional  method 

0.1249 

Corollary  2 

0.4994 

Corollary  3 

0.4996 

Table  5.3:  Comparison  of  the  largest  invariant  sets  guaranteed  by  Theorem  7  and  by  conventional  method 
using  diagonal  scalings 


5.4.5  Stabilizing  nonlinear  systems  using  gain-scheduled  approach 


In  this  example,  we  show  that  our  approach  can  be  applied  to  the  design  of  output  feedback  controllers  for 
parameter-dependent  nonlinear  systems  with  real  rational  nonlinearities. 

Consider  the  following  nonlinear  system: 
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(5.42) 


We  design  an  output  feedback  controller  (see  [EGS96]  for  details)  such  that: 

1.  £p  =  {x\  xT Px  <  1}  is  an  invariant  set  (ellipsoid)  inside  the  box  Ba  ==  {a? |  |x,*|  <  0.5,  i  =  1,2),  where 
P  defines  a  quadratic  Lyapunov  function  which  gives  a  guarantee  for  the  local  stability  around  the 
origin. 
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2.  The  upper  bound  on  output  peak  ymax  is  minimized.  Note  that  this  requirement  can  be  enforced  by 
the  optimization 

Minimize:  y^ax,  Subject  to:  2/max  >  cy Rcy >  (5*43) 

where  R  is  the  left  upper  block  of  P_1,  defined  in  (5.30). 

Note  that  there  are  several  methods  to  search  for  the  quadratic  Lyapunov  function  corresponding  to 
£p.  By  combining  conditions  in  Theorem  8  and  LMIs  (5.41)  and  (5.43),  we  can  design  an  output  feedback 
controller  with  a  guaranteed  upper  bound  of  output  peak  of  4.6465  when  the  initial  condition  xq  E  £p. 
By  using  conventional  method  with  structured  scalings  [AG95,  EGS96],  however,  the  best  upper  bound  is 
7.8314.  The  improvement  by  using  our  method  is  up  to  40%. 


5.5  Conclusion 

We  have  presented  new  algorithms  for  the  stability  analysis  and  gain-scheduled  controller  synthesis  for 
linear  systems  affected  by  parametric  uncertainties.  We  have  also  established  that  these  algorithms  offer 
significant  improvement  over  existing  methods.  The  analysis  and  synthesis  conditions  are  in  the  form  of 
linear  matrix  inequalities;  therefore,  our  algorithms  can  be  very  efficiently  implemented  numerically.  The 
techniques  presented  in  this  chapter  can  be  applied  to  parameter-dependent  nonlinear  systems  with  real 
rational  nonlinearities,  using  the  approach  of  [EGS96].  In  addition,  several  of  the  techniques  proposed  in 
this  chapter  can  be  extended  to  the  solution  of  robust  performance  problems. 


5.6  Proofs 

Theorem  10  System,  (5.6)  is  quadratically  stable  if  and  only  if  there  exists  P  —  PT  >  0  such  that  for  any 
uncertainty  A  E  A  which  is  defined  in  (5.7),  the  following  condition  holds 

r  ATP  +  PA-C?Cp  P(BqA)  +  C?-C?(DpqA)  1 

.  (BqA)TP  +  Cp  -  (Dpq A)TCP  (DpqA)  +  (DpqA)T -(DpqA)T(DpqA)-I  J 

Moreover,  if  D  —  0,  condition  (5.44)  equivalent  to  (5.14)  with  Si  =  —  Q  =  I. 

Proof:  The  connection  between  (5.44)  and  (5.14)  is  very  straight  forward  when  D  =  0.  Therefore,  we  only 
need  to  show  condition  (5.44)  holds  for  general  case. 

Sufficiency 

By  Schur’s  Complements  Lemma,  condition  (5.44)  is  equivalent  to  for  all  A  E  A 

P(A  +  BqA(I  -  DpqA)~lCp)  +  (A  +  BqA(I  -  DpqA)~1Cp)T P 

+PBqA(I-DpqA)~1(I-DpqA)-TATBjP<0. 

Therefore  the  quadratic  stability  of  system  (5.6)  follows  immediately.  Also  note  that  condition  (5.44)  implies 
that  system  (5.6)  is  well  posed. 

Necessity 

Suppose  system  (5.6)  is  quadratically  stable.  Then,  there  exists  P  =  PT  >  0  such  that 

L(A)  =  P(A+BqA(I-DpqA)-1Cp)  +  (A  +  BqA(I-DpqA)-1Cp)TP  <0,  VA  G  A.  (5.45) 
Let 

V  =  sup  (Amax(L(A))), 

Ag  A 

where  Amax  denotes  the  largest  eigenvalue.  Obviously  rj  <  0.  We  shall  show  that  tj  <  0.  This  follows  from 
the  fact  that  A  is  a  compact  set  and  Amax(-)  is  a  continuous  function.  If  rj  =  0,  there  must  exists  some 
A  €  A  such  that  Amax(Z,(A))  =  r]  =  0,  which  contradicts  the  assumption  (5.45). 

Since  the  system  is  well  posed  (Otherwise,  it  can  not  be  quadratically  stable),  det(7  —  Dpq A)  ^  0  for  all 
A  G  A.  This  implies  {I  -  DpqA)(I  -  DpqA)T  >  0  for  all  A  G  A.  Following  the  same  argument  as  before,  we 
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get  infA6A  Amin ((I  -  DpqA)(I  -  Dpq A)T)  =  r  >  0,  or  equivalently  || (I  -  Dpq A) 
Define  P  =  £P  where 


-T  ||2 


<  l/r  for  all  A  G  A. 


0<£<  - 


T7] 


^max  (P  BqBj  P)/j.  ’ 


l|A||2<^  ^>0. 


It  is  easy  to  check  that  P  is  a  feasible  solution  for  inequality  (5.44).  Thus  we  showed  that  (5.44)  is  a  necessary 
condition  for  quadratic  stability.  n 
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Part  II 


Gain-Scheduled  Control  of  the  ONR 

UCAV 


Chapter  6 


Gain-scheduled  control  of  the  ONR 
UCAV 


The  dynamics  of  Unmanned  Combat  Air  Vehicles  (UCAVs)  undergoing  aggressive  maneuvers  are  highly 
nonlinear  and  time- varying.  One  approach  towards  modeling  UCAVs  involves  linearizing  the  dynamics  of 
the  UCAV  around  various  points  in  the  flight  envelope.  Then,  the  composite  model  of  the  UCAV  can  be  given 
as  a  linear  parameter-dependent  model,  with  the  parameters  being  the  flight  conditions.  A  comprehensive 
effort  towards  identifying  such  models  is  currently  being  undertaken  at  Texas  A  &  M  University. 

We  describe  here  research  efforts  towards  a  systematic  design  procedure  for  controller  synthesis  for  the 
linear  parameter-dependent  ONR  UCAV  models.  Traditional  techniques  for  controller  synthesis  consist  of 
designing  a  single  controller  that  is  intended  to  function  across  varying  flight  conditions.  These  include 
constant  state-feedback,  as  well  as  the  celebrated  LQR/LQG  and  Hoo  controllers.  While  these  control 
techniques  can  be  sometimes  proven  to  work  (i.e.,  stabilize  the  system  or  provide  acceptable  performance), 
they  can  be  quite  conservative,  especially  when  the  flight  conditions  vary  considerably. 

Gain-scheduled  controller  design  offers  the  potential  much  more  aggressive  control  design.  The  basic 
idea  is  to  synthesize  a  series  of  dynamic  controllers,  one  for  each  linearized  model  of  the  UCAV  around 
a  flight  condition,  and  then  ’’schedule”  these  controllers  according  to  the  actual  flight  condition.  An  ad 
hoc  implementation  of  such  a  scheme  is  not  guaranteed  to  work;  however,  it  is  possible  to  develop  a  gain¬ 
scheduling  scheme,  using  Lyapunov  functions,  that  is  guaranteed  to  work  across  various  flight  regimes. 

Another  advantage  of  an  approach  based  on  Lyapunov  functions  is  that  it  can  be  extended  to  handle 
constraints  other  than  mere  stability.  Stability  requires  the  Lyapunov  function  to  decrease  along  the  tra¬ 
jectories  of  the  parameter- varying  system.  Additional  constraints  on  the  Lyapunov  function  can  be  used 
to  design  controllers  with  guaranteed  performance.  Examples  of  performance  measures  are  the  energy  in 
the  state  vector,  and  peak  values  of  signals  of  interest;  in  several  instances,  it  is  desirable  that  these  perfor¬ 
mance  measures  be  small.  And  gain-scheduled  controllers  that  minimize  upper  bounds  on  these  performance 
measures  can  be  designed. 

The  technical  approach  behind  gain-scheduled  control  was  described  in  Part  I  of  this  report,  especially 
in  Chapter  5.  We  now  describe  briefly  some  example  problems  in  the  control  of  the  ONR  UCAV  that  we 
solved  using  our  techniques. 


The  complete  results  of  this  study,  along  with  the  matlab  codes  are  available  at  the  web  site 
http : //www . ece . purdue . edu/~ragu/onr/ gs-contr . html 


0  Joint  work  with  Qing  Su,  School  of  Electrical  and  Computer  Engineering,  Purdue  University. 
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6.1  Example:  Plant  varies  linearly  with  flight  condition 


6.1.1  Stability 

The  UCAV6  linear  models  are  based  on  the  unmanned,  V/STOL  UCAV6  model.  The  online  documentation 
from  the  Texas  A  &  M  website 
http : //aero . tamu . edu/ ucav/ 

provides  more  information  on  the  model.  The  following  table  lists  the  inputs  and  states  for  the  longitudinal 
model. 


Inputs 


Input 

Units 

Description 

(ig 

% 

Elevator  stick  input 

dt 

% 

Throttle  input 

dn 

deg 

Nozzle  angle  input 

State 

Units 

Description 

u 

ft/s 

Velocity  along  x-axis  of  aircraft 

w 

ft/s 

Velocity  along  z-axis  of  aircraft 

Q 

deg/s 

Pitch  rate 

e 

deg 

Euler  angle  rotation  of  aircraft  reference  frame  about  inertial  y- axis 

We  address  the  problem  of  designing  a  stabilizing  controller  that  is  ” scheduled”  by  the  flight  condition.  The 
design  requirement  is  that  with  zero  exogenous  inputs,  the  states  of  the  closed-loop  system  must  converge 
to  zero,  irrespective  of  the  initial  condition. 

The  flight  condition  V  varies  between  10  and  25  knots  as  shown  in  Figure  6.1.  We  assume  that  the  system 
model  varies  linearly  with  the  flight  condition  V  between  the  two  linear  models  of  the  system  corresponding 
to  the  flight  conditions  V  =  10,  and  25  knots  (taken  from  the  Texas  A  &  M  website). 


Figure  6.1:  Flight  condition  variation. 

Using  the  techniques  outlined  in  Chapter  5,  we  designed  a  gain-scheduled  controller  to  stabilize  the 
system.  The  plots  of  the  state  variables  for  the  closed-loop  system  (with  our  gain-scheduled  controller  in 
place),  and  the  control  inputs  are  shown  in  Figure  6.2. 

We  note  that  our  techniques  are  guaranteed  to  stabilize  the  system,  unlike  some  ad  hoc  gain-scheduling 
methods..  .  .  .  *.  . 
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Figure  6.2:  The  longitudinal  states  of  the  closed-loop  system  are  shown  on  the  left.  The  control  inputs  are 
shown  on  the  right. 

6.1.2  Minimizing  L2  gain  from  disturbance  to  output 

With  the  same  flight  condition  profile  as  in  Section  6.1.1,  we  introduce  disturbances  in  all  three  control 
inputs,  as  shown  in  Figure  6.3. 


Figure  6.3:  Disturbances  introduced  at  the  control  input. 

We  now  consider  the  problem  of  designing  a  gain-scheduled  controller  that  minimizes  an  upper  bound 
on  the  worst-case  L2  gain  from  disturbance  (introduced  at  the  control  inputs)  to  the  state.  The  basic  idea 
here  is  to  search  for  Lyapunov  functions  that  satisfy  the  constraint 

jtV{x>t)  <  J2w(t)Tw(t)  -  z(t)Tz(t),  (6.1) 

with  the  smallest  possible  7,  where  w  and  z  denote  the  disturbance  input  and  output  of  interest  respectively. 
(See  Example  2.5.1,  and  inequality  (2.25)' in  Chapter  2.) 

With  this  gain-scheduled  controller  in  place,  Figure  6.4  shows  the  various  state  trajectories  corresponding 
to  the  disturbance  input  in  Figure  6.3,  as  well  as  the  various  control  inputs. 
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Figure  6.4:  The  state  trajectories  with  the  gain-scheduled  controller  that  minimizes  the  L2  gain  from  dis¬ 
turbance  to  output  are  shown  on  the  left.  The  control  inputs  are  shown  on  the  right. 

6.1.3  Minimizing  peak  value  of  the  first  state-component 

With  the  same  flight  condition  profile  as  in  Section  6.1.1,  and  with  the  same  disturbances  as  in  Section  6.1.2, 
we  now  consider  the  problem  of  designing  a  gain-scheduled  controller  that  minimizes  an  upper  bound  on 
the  worst-case  peak  value  of  the  first  component  of  the  state.  The  basic  idea  here  is  to  search  for  Lyapunov 
functions  that  satisfy  the  constraint 

JtV(x,t)<  0,  (6.2) 

and  use  the  invariant  sets  that  arise  to  bound  the  state  variables  (cf.  example  2.5.2  in  Chapter  2). 

With  this  gain-scheduled  controller  in  place,  Figure  6.5  shows  the  various  state  trajectories  corresponding 
to  the  disturbance  input  in  Figure  6.3,  as  well  as  the  various  control  inputs. 
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6.2  Other  example  problems 

We  have  performed  a  comprehensive  study,  employing: 

•  Different  design  objectives. 

♦  Different  UCAV  models  (taken  from  the  Texas  A  &  M  database). 

#  Different  flight  condition  variation  scenarios. 

Hierarchical  description  of  problems  studied 

•  At  the  highest  level,  the  problems  are  classified  according  to  how  the  plant  parameter  vary 
with  the  flight  condition:  linear  and  'polynomial  Our  techniques  extend  to  the  case  when 
the  plant  parameters  are  rational  functions  of  the  flight  condition  as  well. 

•  At  the  next  level,  we  have  studied  six  models  for  the  linear  variation  case: 

-  Longitudinal  UCAV6  model. 

-  Lateral/directional  UCAV6  model. 

-  Longitudinal  VSTOL1  model. 

—  Lateral/directional  VSTOL1  model. 

-  Longitudinal  VSTOL2  model. 

-  Lateral/directional  VSTOL2  model. 

For  the  polynomial  variation  case,  we  have  only  considered  the  longitudinal  and  lat¬ 
eral/directional  UCAV6  model. 

•  At  the  last  level,  for  each  scenario,  we  have  studied  the  following  problems: 

-  Single  objective  problems: 

*  L2  gain  bound  of  10000  from  disturbance  to  output.  i 

*  Minimize  L2  gain  from  disturbance  to  output. 

*  Minimize  L2  gain  from  disturbance  to  first  output. 

*  Minimize  L2  gain  from  disturbance  to  second  output. 

*  Minimize  L2  gain  from  disturbance  to  third  output. 

*  Minimize  L2  gain  from  disturbance  to  fourth  output. 

*  Minimize  peak  value  of  the  state  Euclidean  norm. 

*  Minimize  peak  value  of  the  first  state  component. 

*  Minimize  peak  value  of  the  second  state  component. 

*  Minimize  peak  value  of  the  third  state  component. 

*  Minimize  peak  value  of  the  fourth  state  component. 

—  Multi-objective  problems: 

*  I/2  gain  bound  of  10000  from  disturbance  to  output  +  minimizing  upper  bound  on 
the  peak  value  of  the  Euclidean  norm  of  the  state  vector. 

*  L2  gain  bound  of  10000  from  disturbance  to  output  -f-  minimizing  upper  bound  on 
the  peak  value  of  the  first  state  component. 

*  L2  gain  bound  of  10000  from  disturbance  to  output  +  minimizing  upper  bound  on 
the  peak  value  of  the  second  state  component. 

*  L2  gain  bound  of  10000  from  disturbance  to  output  -f  minimizing  upper  bound  on 
the  peak  value  of  the  third  state  component. 

*  L2  gain  bound  of  10000  .from  disturbance  to  output  •+  minimizing  upper  bound  on 
the  peak  value  of  the  fourth  state  component. 
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Robust  Estimation 


Chapter  7 

Robust  estimation  for  systems  with 
parametric  uncertainties 


We  present  an  adaptive  robust  Kalman  filtering  algorithm  that  addresses  estimation  problems  that 
arise  in  linear  time-varying  systems  with  stochastic  parametric  uncertainties.  The  filter  has  the  one- 
step  predictor-corrector  structure  and  minimizes  the  mean  square  estimation  error  at  each  step,  with 
the  minimization  reduced  to  a  convex  optimization  problem  based  on  linear  matrix  inequalities.  The 
algorithm  is  shown  to  converge  when  the  system  is  mean  square  stable  and  the  state-space  matrices 
are  time-invariant.  A  numerical  example,  consisting  of  equalizer  design  for  a  communication  channel, 
demonstrates  that  our  algorithm  offers  considerable  improvement  in  performance  when  compared  to 
standard  Kalman  filtering  techniques. 


7.1  Introduction 

In  this  chapter,  we  consider  the  robust  estimation  problems  for  the  uncertain  system 

x(k  +  1)  =  A&(k)x(k)  +  BA(k)w(k),  -  v 

y(Jfe)  =  CA(k)x(k)  +  DA(k)w(k)}  z(k)  =  Lx(k).  V  ; 

When  system  (7.1)  contains  mixed  deterministic  and  stochastic  uncertainties,  we  consider  two  problems 
of  optimal  estimation.  The  first  is  the  design  of  a  filter  that  minimizes  an  upper  bound  on  the  worst-case 
mean  energy  gain  (MEG)  between  the  noise  affecting  the  system  and  the  estimation  error.  The  second  is 
the  design  of  a  filter  that  minimizes  an  upper  bound  on  the  worst-case  asymptotic  mean  square  estimation 
error  (MSEE)  when  the  plant  is  driven  by  a  white  noise  process.  We  present  filtering  algorithms  that  solve 
each  of  these  problems,  with  the  filter  parameters  determined  via  convex  optimization  based  on  linear  matrix 
inequalities.  We  demonstrate  the  performance  of  these  robust  algorithms  on  numerical  examples  consisting 
of  the  design  of  equalizers  for  communication  channels. 

When  system  (7.1)  is  time- varying  and  contains  stochastic  parametric  uncertainties  (See  (7.29)),  we 
present  an  adaptive  robust  Kalman  filtering  algorithm.  The  filter  has  the  one-step  predictor-corrector  struc¬ 
ture  and  minimizes  the  mean  square  estimation  error  at  each  step,  with  the  minimization  reduced  to  a 
convex  optimization  problem  based  on  linear  matrix  inequalities.  The  algorithm  is  shown  to  converge  when 
the  system  is  mean  square  stable  and  the  state-space  matrices  are  time-invariant.  A  numerical  example, 
consisting  of  adaptive  equalizer  design  for  a  communication  channel,  demonstrates  that  our  algorithm  offers 
considerable  improvement  in  performance  when  compared  to  standard  adaptive  Kalman  filtering  techniques. 

The  organization  of  this  chapter  is  as  follows.  In  Section  7.2,  we  propose  linear  time-invariant  robust 
MMEG  and  MMSE  estimators  for  uncertain  systems  containing  mixed  deterministic  and  stochastic  uncer¬ 
tainties.  In  Section  7.3,  we  propose  an  adaptive  Kalman  filtering  algorithm  for  linear  time- varying  systems 
with  stochastic  parametric  uncertainties. 

.  0  Joint  work  With  Fan  Wang,  Ph.D.,  School  of  Electrical  and  Computer  Engineering,  Purdue  University.  *• 
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7.2  Robust  estimators  for  systems  with  mixed  deterministic  and 
stochastic  uncertainties 

In  this  section,  we  consider  a  robust  estimation  setting  where  both  deterministic  and  stochastic  uncertainties 
are  present.  For  such  systems  (see  Fig.  7.3),  we  design: 

A  robust  MMEG  filter ,  i.e.,  ,  one  that  minimizes  an  upper  bound  on  the  largest  value  (over  all  possi¬ 
ble  values  of  the  deterministic  uncertainties  and  all  possible  realizations  of  the  mean  energy  bounded 
noise  input  u;)  of  the  mean  energy  gain  (with  the  expectation  taken  over  the  statistics  of  the  stochastic 
uncertainties)  from  the  noise  input  w  to  the  estimation  error  e. 

A  robust  MMSE  filter ,  i.e.,  ,  one  that  minimizes  an  upper  bound  on  the  largest  value  (over  all  possible 
values  of  the  deterministic  uncertainties)  of  the  asymptotic  mean  square  value  (with  the  expectation 
taken  over  the  statistics  of  the  stochastic  uncertainties  and  the  white  noise  input  w )  of  the  estimation 
error  e. 

In  each  case,  the  robust  filter  design  problem  is  reduced  to  a  convex  optimization  problem  based  on  linear 
matrix  inequalities. 


7.2.1  Preliminaries 

Consider  the  parametric  uncertain  system 


where 


x(k  +  1)  =  A&(k)x(k)  +  B&(k)w(k)} 
y(k)  =  C&(k)x(k)  +  D&(k)w(k),  z(k)  =  Lx(k), 


AA(k)  =  Ao  +  'E'Aiftk)  +  BA(k)  =  Bo  +  £>&“(*)  +  !>/</(*)’ 


(7.2a) 


t= i 
n 


;= i 

m 


i=l 

n 


i= i 

m 


(7.2b) 


cA(k)  =  a, + E  +  E  eye; (*).  D*(k)  =  Do  +  E  BtCfw  +  E  DKj(k)- 

t- i  j=i  t=i  i=i 

The  system  has  mixed  deterministic  and  stochastic  uncertainties.  It  is  said  to  be  mean  square  stable  if  with 
w(k)  —  0  and  for  all  k  E  Z+,  we  have 


lim  E  [x(A:)x(^)t]  =  0, 

k^oo 


regardless  of  the  initial  condition  z(0). 
Let 


Qi  = 


Ai  Bi 
Ci  Di 


,  i  =  1,...,2" 


(7.3) 


be  the  vertices  of  the  poly  tope 


/ 

r  n 

^o+E^c" 

n  1 

■So  +  E  Ct 

Q,  =  < 

t= i 

Co  +  f^CfC? 

tzzl 

t= i 

Do  +  jrD?Cf 

t= i 

\cf\  <  i  ► 

j 

The  following  lemma  gives  a  sufficient  condition  for  the  mean  square  stability  of  system  (7.2).  This  lemma 
is  an  extension  of  the  corresponding  result  for  systems  with  stochastic  parametric  uncertainties  in  [BEFB94, 
Chapter  9]  to  systems  with  mixed  deterministic  and  stochastic  uncertainties. 

Lemma  7.2.1  System  (7.2)  is  mean  square  stable  if  there  exists  a  matrix  Q  >  0  such  that 


.  .  Aj  QAi  -Q  +  Yj(A’j)TQ(A3j)  <  0,  i  =  1, . . 2".  . 

i= i 

Moreover,  the  quadratic  Lyapunov  function  V(x(k))  =  E  [x(k)T Qx{k)\  satisfies  V(x(k))  \  0 


(7.4)  • 
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Proof:  Let  X(k)  =  E  [x(k)T  x(k)]  and  A(k)  =  A0  +  AfCt(k).  Suppose  that  there  exists  a  matrix 
Q  >  0  such  that  condition  (7.4)  holds.  By  convexity,  condition  (7.4)  implies  that 

m 

A(k)TQA(k)-Q  +  J2(A,j)TQ(Asj)<0,  k  =  0,1,2,...  (7.5) 

j  =  1 

With  w(k)  =  0,  k  =  0, 1, . . the  correlation  of  the  states  of  system  (7.2)  satisfies  the  recursion 

m 

X(k  +  1)  =  A(k)X(k)A(k)T  +  YJA)X{k){A])T . 

j=l 

Define  a  Lyapunov  function  V"(a;(^))  =  E  [x(k)T Qx(k)] .  If  X(k)  ^  0,  then  K(#(fc))  >  0,  and 


V(x(k  +  1))  -  V(x(k))  =  Tr(X(k)  A(k)TQA(k)  -Q  +  ^(Ajf  Q(A$)  ). 


*=i 


From  (7.5),  we  get  V(x(k  -fi  1))  —  V(x(k))  <  0.  On  the  other  hand, 

V(x(k  +  1))  -  V(x(k))  =  Tr((X(k  +  1)  -  X(k))Q). 

Since  Q  >  0,  we  get  X(k  +  1)  <  X(fc).  Thus  X(k)  is  monotonically  decreasing  as  k  — ►  oo.  Moreover,  it  can 
be  argued  that  X(k  +  1)  <  7]X(k)  with  rj  E  [0, 1).  Therefore  we  have  limjfc-.oo  X(k)  =0.  □ 

Lemma  7.2.1  gives  a  sufficient  condition  for  the  mean  square  stability  of  system  (7.2).  If  there  is  no 
deterministic  uncertainty,  i.e.,  ,  6f(k)  =  0,2=  1, . . . ,  n,  k  =  0, 1, . . then  condition  (7.4)  is  also  necessary  for 
the  system  to  be  mean  square  stable  [BEFB94,  pp.  136-137].  However,  in  more  general  cases,  condition  (7.4) 
is  not  necessary  since  it  requires  the  use  of  a  single  quadratic  Lyapunov  function  to  prove  the  mean  square 
stability  of  system  (7.2)  for  all  possible  choices  of  state  matrices  A(&).  If  there  exists  a  matrix  Q  >  0  such 
that  condition  (7.4)  holds,  system  (7.2)  is  said  to  be  mean  square  quadratically  stable. 

Our  objective  here  is  to  design  an  LTI  signal  estimator 

Xf(k  +  1)  =  AfXj(k)  +  Bjy(k),  z(k)  =  CfXf(k),  (7.6) 

where  x/(k)  £  Rni/Xnir  . 

We  may  write  down  a  state  space  realization  for  the  interconnection  in  Fig.  7.3: 

x(k  +  1) 

_  Xf(k  +  1) 


We  will  focus  on  two  design  objectives: 

•  Robust  MMEG  filter  design 

With  a:(0)  =  0  almost  surely,  we  wish  to  determine  the  estimator  parameters  {Aj ,  Bj ,  Cj}  to  solve  the 
following  problem: 

Minimize :  7oo 

oo 

Subject  to:  5>[IM*)II3]<1, 

k= 0 
oo 

<  Too- 

k=0 

This  has  the  interpretation  of  minimizing  an  upper  bound  on  the  largest  value  (over  all  possible  values 
of  the  deterministic  uncertainties  and  all  possible  realizations  of  mean  energy  bounded  noise  input  w)' 
of  the  mean  energy  gain  (with  the  expectation  taken  over  the  statistics  of  the  stochastic  uncertainties) 
from  the  noise  input  w  to  the  estimation  error  e. 


AA(k)  0 

x(k) 

1 

BA(k) 

BfCA(k)  A} 

xf(k) 

T 

BfDA(k) 

w(k), 


e(k)  =  [  L  -Cj] 


x{k) 
xj(k)  I 


(7.7) 
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•  Robust  MMSE  filter  design 

We  wish  to  determine  the  estimator  parameters  {Aj ,  Bj  ,Cf}  to  solve  the  following  problem: 

Minimize:  72 

Subject  to:  3N  s.t.  E  [||e(&)||2]  <72 >  TV, 

where  w  is  zero-mean  unit  variance  white  noise.  This  has  the  interpretation  of  minimizing  an  upper 
bound  on  the  largest  (over  all  possible  values  of  the  deterministic  uncertainties)  asymptotic  mean 
square  value  (with  the  expectation  taken  over  the  statistics  of  the  stochastic  uncertainties  and  the 
white  noise  input  w)  of  the  estimation  error  e. 

7.2.2  Robust  MMEG  filter  design 

In  this  section,  we  consider  the  robust  MMEG  filter  design  problem.  For  system  (7.2),  with  z(0)  =  0  almost 
surely,  the  quantity 

00 

sup  ^£[||2/(fc)H2]  (7.8) 

^pE[\\w(k)\f}<lXdy=0 

will  be  referred  to  as  the  worst-case  mean  energy  gain  (worst-case  MEG).  The  following  lemma  gives  a 
sufficient  condition  for  the  worst-case  MEG  to  be  less  than  a  level  . 

Lemma  7.2.2  The  worst-case  MEG  of  system  (7.2)  is  less  than  700  if  there  exists  a  matrix  P  >  0  such  that 

"  V  AiP  Bi  0 

PAJ  P  0  PCf 

Bj  0  Toe  /  Vj 
0  CiP  Vi  I 

where  V  =  diagP,  •  -  ■ ,  P  and 

Ai  =  [(^)T,  (Aif,  {A’m)T]T,  Bi  =  [(Bi)T,  (B[)T ,  (B’m)T]T, 

Ci  =  T,  ^  =  [(Di)T ,  (Dsm)T]T . 


>0,  i=l,...,2n, 


(7.9) 


Proof:  First,  let  us  define  a  Lyapunov  function  K(x(A:))  =  E  [x(k)T Qx(k)]  with  Q  >  0.  If 

V(x(k  +  1))  -  V(x(k))  <  y„E  [|M*)||2]  -  E  [||y(fc)||2]  ,  (7.10) 

we  then  have 

oo  oo 

k- :0  A;=0 

Following  the  same  argument  as  in  the  proof  of  Lemma  7.2.1,  it  can  be  checked  that  condition  (7.10)  is 
equivalent  to  LMI  condition 


'  Q  O' 

'  Ai  Bi  ' 

T 

'so' 

'  Ai  Bi  ■ 

0  Tool 

.  Ci  Vi 

0  I 

1  Ci  V’-  . 

where  Q  =  diagQ,  •  •  • ,  Q.  With  a  change  of  variable  P  =  Q  x,  and  standard  matrix  manipulations,  it 
follows  that  condition  (7.11)  is  equivalent  to  (7.9).  □ 

The  upper  bound  on  the  worst-case  MEG  given  by  (7.9)  can  be  conservative  in  general.  However,  if 
there  exist  no  deterministic  uncertainties,  it  turns  out  that  the  upper  bound  is  tight,  i.e.,  it  equals  the  worst- 
case  MEG.  We  also  note  that  if  the  worst-case  MEG  is  bounded,  then  the  system  must  be  mean  square 
quadratically  stable.*  This  simply  follows  from  the  fact  that  (7.9)  implies  that 


V  AiP 
PAJ  P 


>0,  i=  l,...,2n, 
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which  is  equivalent  to  condition  (7.4)  with  Q  =  P~l . 

We  are  now  ready  to  state  our  main  result  on  the  robust  MMEG  filtering,  that  a  robust  MMEG  filter 
for  system  (7.2)  can  be  designed  by  solving  a  set  of  linear  matrix  inequalities. 


Theorem  11  For  the  uncertain  system  (7.2),  there  exists  a  full  order  LT I  filter  (7.6)  such  that  the  worst- 
case  MEG  from  the  input  noise  w  to  the  estimation  error  e  is  less  than  y^  if  there  exist  Z  =  ZT ,  Y  — 
Yt,  H  E  RniXn*,  F  6  R"*x"*,  and  G  £  R"‘xn*  such  that 
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>0,  j  =  1, . . . ,  2”, 


(7.12) 
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Aj0  — 
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YBi  +  FDi 

Aj,j  — 
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.  B,j  = 
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[  Y  A]  +  FCj  Y  A]  +  FC] 

If  there  is  no  deterministic  uncertainty,  the  smallest  jco  such  that  (7.12)  holds  is  the  exact  value  of  MEG. 
Proof:  The  central  part  of  the  proof  is  a  change-of- variable  technique  due  to  [GBG98].  From  Lemma  7.2.2, 
we  have 


E^[IK*)Ha]/E^[H*)Ha]<Tco, 


k- 0 


if  there  exists  a  matrix  P  >  0  such  that 


fc= o 


where 
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Let  P  be.  partitioned  as 
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Af 

Bj 

’Di 

A{ 

0 

B{ 

BfC{ 

0 

,  Bi  = 

BjD[ 

Asm 

0 

BI 

BjC(n 

0 

Bj 

Ds 

J 

>0,  i  =  1, . .  .,2n, 


P  = 


X  U 
UT  * 


and  P  1  = 


Ct  =  [L  -Cj}. 


Y  ■  V 

VT  * 


(7.14) 


(7.15) 


82 


where  X,  Y  E  RnrXni,  {/,  V  £  RnxXnx/.  According  to  the  matrix  completion  lemma  (see  for  exam¬ 
ple  [Pac94]),  by  requiring  nXj  ~  nX)  such  a  decomposition  is  feasible  for  some  fixed  X  and  Y  if  and  only  if 
X  and  Y  satisfy  X  >  Y”1  >  0. 

Define  new  variables 

H  =  VAfUTX~\  F  =  VBj ,  G^CfUTX~\  (7.16) 

and  Z  =  X-1.  Note  that  we  may  always  require  Y  being  nonsingular  in  (7.15).  If  V  is  singular,  we 
may  add  some  perturbations  on  P  to  enforce  this  requirement.  Multiplying  by  diagT^,  •  •  • ,  T7, 7,  /  and 
diagT,  •  •  • ,  T,  /,  /  from  both  sides  of  (7.14),  where 


r  = 


Z  Y 
0  VT  ’ 


we  get  the  linear  matrix  inequality  (7.12).  Since  T  is  nonsingular,  (7.12)  and  (7.14)  are  equivalent.  By 
Schur’s  complement  lemma,  the  condition  X  >  Y~1  >  0  is  implied  by  the  LMI  (7.12). 

If  there  is  no  deterministic  uncertainties,  the  set  of  uncertainties  Q  becomes  a  fixed  point.  According  to 
the  bounded  real  lemma  for  discrete  time  systems,  the  second  part  of  the  theorem  is  proved  immediately. 
This  completes  the  proof.  D 

Condition  (7.12)  is  sufficient  for  the  existence  of  an  LTI  filter  such  that  the  worst-case  MEG  from  w  to 
e  of  system  (7.2)  is  less  than  y^.  By  minimizing  y oo,  we  can  design  an  optimal  robust  MMEG  filter.  This 
becomes  the  following  semidefinite  programming  problem  ([VB96]): 


Minimize:  700,  Subject  to:  (7.12). 


(7.17) 


We  summarize  the  various  steps  comprising  the  construction  of  a  robust  MMEG  filter  using  the  feasible 
solution  of  LMI  (7.12). 

Robust  MMEG  Filtering  Algorithm 

1.  Solve  the  semidefinite  programming  problem  (7.17)  and  find  the  optimal  values  of  X,  Y,  ff ,  Ft  and  G. 

2.  Define  V  =  (Y  —  X)1/2  and  U  =  —  Z~x V.  Note  that  (7.12)  implies  Y  >  Z  and  that  V  is  nonsingular. 

3 .  Construct  the  state-space  matrices  of  the  optimal  MMEG  estimator 


Af 

Bf 

■  y-1 

0  ' 

'  H  F 

'  -V-1  0  ' 

C} 

0 

0 

I 

G  0  _ 

0  1 

We  also  note  that  E  [x(k)Qx(k)\,  where 

[  y  (y  -  z )1'7 ' 

^  [(Y-Z)1/2  I  J’ 

is  a  quadratic  Lyapunov  function  that  guarantees  that  irrespective  of  Cd ,  we  have 

OO  OO 

Y  E  [IK^OII2]  /Ye  0Kfc)H2]  <  Too  • 

fc=0  fc=0 


7.2.3  Robust  asymptotic  MMSE  filter 


Suppose  the  input  w  is  a  zero- mean  white  noise  process,  and  satisfies  the  condition  E  [w(i)w(j)T]  =  S(i—j)L 
We  now  consider  the  problem  of  designing  a  linear  time  invariant  filter  (7.6)  that  minimizes  an  upper  bound 
on  the  largest  (over  all  possible  values  of  the  deterministic  uncertainties)  asymptotic  mean  square  value  (with 
the  expectation  taken  over  the  statistics  of  the  stochastic  uncertainties  and  the  white  noise  input  w)  of  the 
estimation  error  e: 


Minimize:  72, 

Subject  to:  3 N  s.t.  E  [||e(&)||2]  <  72  for  k  >  N . 


(7.19) 


We  begin  with  the  following  lemma. 
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Lemma  7.2.3  Consider  system  (7.2).  Suppose  there  exists  a  matrix  P  >  0  such  that  for  i  —  1, . .  .  ,2n, 

m 

AiPAj  -P+  BiBj  +  Y  (W)P(Aj)T  +  B](B])t)  <  0.  (7.20) 

j  =  1 

Then  there  exists  N  >  0  such  that  if  k  >  N ,  then  E  [x(k)x(k)T]  <  P.  Moreover ,  if  P  >  E  [z(0):c(0)T], 
then  E  [z(£)£(fc)T]  <  P  for  every  k  >  0. 

Proof:  Suppose  that  there  exists  P  >  0  such  that  (7.20)  holds.  Let  A(k)  =  Ao  +  £**(&)  and 

P(fc)  =  Po  +  #**£/(£)•  Since  {.A(&),  i?(&)}  E  Co Ai,Bi,  i  =  1, . . . ,  2n,  where  A,*,  Bi  are  defined  in  (7.3), 

we  have 

m 

A(k)P  A{k)T  —  P  +  B(k)B(k)T  +  Y(Aj)P(Aj)T  +  5i(5/)T  < 

J=  1 

for  some  e  >  0. 

By  (7.2),  X(&)  =  P  [:c(fc);n(fc)T]  satisfies  the  recursion 


X(k  +  1)  =  A(k)X(k)A(kf  +  B{k)B{k)T  +  Y  (AjX(k)(Ajf  +  B^Blf)  . 

j=i 

We  then  have 

m 

P  -  X(k  +  1)  >  A(k)(P  -  X(k))A(k)T  +  YAi(P  ~  X(k)XAj)T  +  eL 

J= i 

It  can  be  verified  that  P  —  X(k  +  1)  >  M(k  +  1)  -f  e/,  where 

m 

M(k  +  1)  =  A(k)M(k)A(k)T  +  Y  AjM(k)(Ajf, 

j  =  l 

and  M( 0)  =  P  —  X(0).  Then,  from  Lemma  7.2.1,  we  have  limjb_,oo  M(k)  =  0.  Therefore,  there  exists  N 
such  that  if  k  >  N,  then  P  >  X(k).  To  prove  the  second  claim,  suppose  that  P  >  X(0).  It  can  be  then 
immediately  verified  that  P>X(fc)forfc>0.  n 

Lemma  7.2.3  provides  a  solution  to  the  asymptotic  MMSE  filtering  problem. 

Theorem  12  For  the  system  (7.2),  there  exists  a  full  order  LTI  filter  (7.6)  such  that  E  [||e(&)||2]  <  72  when 
k  is  large  enough  if  there  exist  Z  =  ZT ,  Y  =  YT ,  H  E  RnxXn*;  F  E  Rn*xnv;  and  G  E  Rn*xnx  such  that 


Tr(W)  <72, 


z  z  lt  -gt  ' 

'  Z 

Mi2i  M13  i  1 

Z  Y  LT 

>0, 

m?2, 

M2  2 

0 

L-G  L  W 

1  MTs,i 

0 

1 

(7.21) 


where 


Z 


M22  — 


Z 


M\2 ti  —  •A*/* 0  •Af,  1  '  *  *  Ajtm  j 


=  [  B^  0  Bjti  -  •  •  Bf)Tn  ]  , 

with  Z ,  A1j  q,  Afti,  . . . ,  Af}m,  Blj  0,  Bj'i,  . . . ,  Bj}TYI  defined  in  (7.13). 

Proof:  The  proof  of  Theorem  12  is  similar  to  that  of  Theorem  11. 

First,  from  Lemma  7.2.3,  there  exists  a  filter  (7.6)  such  that  E  [||e(fc)||2]  <  72  when  k  is  large  enough,  if 


r  rT  1 

r  p 

AiP  Bi  ' 

Tr(lV)  <  72, 

[L  -Cj}P 

1 

_ 1 

<  iv, 

Sico 

V  0 

0  / 
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where  V  =  diagP,  *  •  • ,  P}  and 


Ai  0 

A\  0 

Atn  0  ' 

BfQ  Af 

BfC[  0 

BjC*m  Oj 

and 

Bi=[Bi  BfDi  |  B[  BfD[  |  |  B°m  BfD*m). 

Using  the  same  change- of- variable  technique  as  in  the  proof  of  Theorem  11,  the  claim  made  in  the  theorem 
follows.  □ 

The  following  algorithm  constructs  a  robust  asymptotic  MMSE  filter  for  system  (7.2)  based  on  Theo¬ 
rem  12. 


Robust  Asymptotic  MMSE  Filtering  Algorithm 

1.  Solve  the  semidefinite  programming  problem 

Minimize:  72, 


Subject  to:  (7.21), 

and  find  the  optimal  values  of  Z>  Y,  Hy  Ft  and  G. 

2.  Define  V  -  (Y  -  Z )x/2  and  U  =  -Z~XV . 

3.  Construct  the  desired  asymptotic  MMSE  filter  by 


’  Af  Bf  ' 

O 

'  H  Fir  -V-1  0  1 

Cf  0 

O 

_ 1 

0 

.  1 

0 

e> 

_ 1 

(7.23) 


(7.24) 


In  addition,  the  Lyapunov  function  E[x(k)Qx(k)\}  where 


Q  = 


Y  (Y-Z)1/2' 
(Y  -  Z)1!2  I 


guarantees  that  E  [||e(Ar)[|2]  <  72  when  k  is  large  enough. 

Our  robust  steady  state  filtering  algorithm  extends  the  results  in  [GBG98,  PM96]  by  incorporating 
stochastic  uncertainties  in  the  system  model.  In  addition,  our  filtering  algorithm  also  has  the  advantage 
that  the  so-called  mixed  performance  filtering  problem  [KRB96]  can  be  solved  easily  by  combining  the 
corresponding  LMI  conditions.  This  will  be  illustrated  with  the  numerical  example  that  we  describe  next. 


7.2.4  A  numerical  example:  LTI  equalizer  for  communication  channels 


We  present  an  application  of  the  robust  MMEG  and  MMSE  filtering  techniques  on  designing  a  linear  time 
invariant  equalizer  for  a  communication  channel.  Consider  the  following  HR  model  of  a  communication 
channel 


x(k  +  1)  = 


y(k)  = 


1  +  C(k) 

1  +  CW 


0.1  0.5 
0  0.1 

1  T 


x(k)  + 


1 

1 


s(k), 


x(k)  -h  (5  H-  C(k))s(k)  -f  0.3 w(k). 


(7.25) 


s(k)  is  the  signal  that  is  transmitted  through  the  channel,  and  w  is  an  additive  measurement  noise.  The 
channel  model  (7.25)  is  affected  by  time- varying  uncertainties  £  that  are  a  combination  of  mixed  deterministic 
and  stochastic  parametric  uncertainties  (see  for  example,  [MC88]).  Specifically,  £(&)  =  O.lCd(^)  +  0.5 (s(k)y 
where:  Q(k)  is  deterministic,  satisfies  |Cf(&)|  <  I  for  all  k ,  and  can  be  measured  in  real-time;  (s  is  a 
zero-mean  white  noise  process  with  a  unit  variance,  and  is  independent  of  w  and  s. 

For  the  channel  (7.25),  we  will  design  an  LTI  equalizer  to  estimate  the  input  signal  s{k)  (Fig.  7.1).  We 
will  allow  ourselves  a  unit  delay  in  equalization. 
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Figure  7.1:  A  communication  channel  with  an  equalizer 


In  order  to  apply  the  technique  proposed  in  Sections  7.2.2  and  7.2.3  to  equalize  the  channel  (7.25),  we 
need  to  add  one  more  state  variable  in  (7.25).  The  unit  delay  in  equalization  adds  another  state  variable, 
resulting  in  the  following  description  of  the  channel  model. 
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If  the  signal  s  and  the  noise  w  are  white  noise  processes,  then  the  robust  MMSE  filtering  algorithm 
presented  in  Section  7.2.3  can  be  used  to  design  an  estimator  that  minimizes  an  upper  bound  of  the  worst- 
case  MSE  of  the  estimation.  We  will  impose  an  additional  requirement  on  the  estimator  that  it  should  also 
satisfy  a  worst-case  MEG  requirement  [KRB96];  this  can  be  thought  as  a  safeguard  against  the  possibility 
that  the  statistics  of  w  are  not  actually  white.  Specifically,  with  a  prescribed  mean  energy  gain  bound  of  700 
in  effect,  we  will  design  an  optimal  steady  state  MMSE  filter.  The  mixed  performance  filtering  problem  is: 


minimize:  72, 

Subject  to:  (7.12),  (7.13)  and  (7.21). 


(7.26) 


The  dashed  line  in  Fig.  7.2  shows  the  best  bound  on  the  asymptotic  MMSE  of  the  estimation  with  no 
MEG  constraint.  This  is  simply  the  optimal  answer  from  the  semidefinite  programming  problem  (7.23).  The 
solid  line  shows  the  optimal  values  of  problem  (7.26)  as  a  function  of  the  MEG  constraint  700.  Corresponding 
to  every  point  on  the  tradeoff  curve  represented  by  the  solid  line,  an  LTI  equalizer  can  be  constructed  that 
is  guaranteed  to  yield:  (i)  a  worst-case  MEG  from  w  and  $  to  e  that  is  less  than  7^;  and  (ii)  with  unit 
variance  white  noise  processes  w  and  s,  an  asymptotic  worst-case  MSE  of  the  estimation  that  is  less  than 
72- 


7.3  Robust  adaptive  Kalman  filters  for  linear  time-varying  sys¬ 
tems  with  stochastic  parametric  uncertainties 

In  this  section,  we  consider  the  robust  estimation  problem  for  linear  time- varying  systems  with  stochastic 
parametric  uncertainties.  For  such  systems,  we  present  an  adaptive  robust  Kalman  filtering  algorithm. 

7.3.1  Preliminary 

First,  let  us  consider  a  linear  time- varying  system 

x(k  +  1)  =  A{k)x(k)  +  B(k)w(k),  y(k)  =  C(k)x(k)  +  D(k)u(k),  (7.27) 
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Figure  7.2:  Tradeoff  between  the  MEG  and  MSE  performance  constraints 


where  k  E  Z+,  x(k)  E  Rn  is  the  state,  w(fc)  E  Rnw  is  the  input  noise,  y(k)  E  Rny  is  the  measured 
output,  and  u(Ar)  E  Rn“  is  the  measurement  noise,  w  and  u  are  independent  white  noise  random  processes. 
Equations  (7.27)  model  systems  which  are  affected  by  both  actuator  and  sensor  noises  (w  and  u  respectively). 
A  fundamental  problem  associated  with  such  systems  is  that  of  state  estimation ,  i.e.,  the  “optimal”  estimation 
of  the  state  #(£)  from  the  noisy  measurements  { y(i ),  i  =  0, 1, . . . ,  k};  the  corresponding  state  estimation  is 
denoted  x(k\k).  Such  estimation  problems  arise  in  several  applications  in  control,  communications  and  signal 
processing;  see  for  example,  [Men95,  GKN+74]  and  the  references  therein. 

Recursive1  minimum  mean  square  estimators  (MMSE)  form  an  important  class  of  optimal  state  estimators 
for  system  (7.27)  [GKN+74,  MC88,  Pro95,  OPG96].  They  minimize  the  expected  value  of  the  square  of  the 
estimation  error,  i.e.,  E  [{x(k)  -  x(k\k))T (x(k)  -  i(fc|fc))],  at  each  k.  When  the  random  processes  w  and  u 
are  Gaussian,  it  turns  out  that  the  MMSE  estimator  is  a  linear  filter  whose  coefficients  can  be  determined  by 
solving  a  Riccati  difference  equation.  (This  is  the  celebrated  Kalman  filter.)  When  w  and  u  are  not  Gaussian, 
the  Kalman  filter  yields  the  best  linear  MMSE  estimator.  An  important  (and  desirable)  property  of  the 
Kalman  filtering  algorithm  is  that  it  converges  when  system  (7.27)  is  stable  and  time-invariant  [Koc79]. 

The  Kalman  filter  consists  of  the  following  two  parts: 

1.  One-step  prediction  update: 

Xf(k)  =  A(k  -  l)xf(k  -  1)  +  K(k  -  1  )(C(k  -  l)xj(k  -  1)  -  y(k  -  1)), 

x(k\k  —  1)  =  Xf(k),  '  ‘ 


2.  Filtered  estimation  update: 

x(k\k)  =  x(k\k  -  1)  +  F(&)(C(fc)£(fc|fc  -  1)  -  y(k)). 


(7.28b) 


When  the  matrices  A{k),  B(k),  C(k),  and  D(k)  in  (7.27)  can  be  measured  exactly,  computing  the 
Kalman  gains  I<(k  -  1)  and  F(k)  in  (2)  is  equivalent  to  a  quadratic  optimization  problem,  one  that  can 
be  solved  analytically  [Koc79].  However,  in  many  cases,  there  exist  uncertainties  in  model  parameters 

1  In  the  following,  we  will  use  the  terms  “recursive”  and  “adaptive”  interchangeably. 
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and/or  model  structure  because  of  errors  from  system  identification  routines  or  model  reductions,  see  for 
example  [MC88,  CC94,  OPG96,  KG96].  The  performance  of  estimators  designed  without  accounting  for  these 
uncertainties  can  be  severely  degraded,  and  sometimes  even  unacceptable  [Hay89].  Thus,  robust  Kalman 
estimators  must  be  designed  with  graceful  performance  degradation  in  the  presence  of  modeling  errors. 

Another  issue  in  Kalman  filtering  design  is  the  initialization  of  the  adaptive  algorithm.  The  standard 
adaptive  Kalman  filter  is  initialized  in  an  ad  hoc  manner,  leaving  room  for  improvement  in  its  transient 
performance. 

Here  we  consider  MMSE  estimation  problems  for  linear  time-varying  systems  affected  by  stochastic 
uncertainties,  with  a  view  towards  optimizing  the  “transient  performance55  of  the  estimation.  The  stochastic 
uncertainties  that  we  consider  affect  the  system  matrices;  in  addition,  we  assume  that  the  correlation  of  the 
state  initial  condition  is  known  only  to  lie  in  a  poly  tope2.  For  such  systems,  starting  with  the  standard  one- 
step  predictor-corrector  filter  structure  (2),  we  develop  a  recursive  estimation  algorithm  where  at  each  step,  an 
upper  bound  of  the  worst-case  value,  over  all  possible  initial  values  of  the  state  correlation,  of  the  mean  square 
of  the  estimation  error,  is  minimized.  The  minimization  is  performed  via  numerical  convex  optimization  over 
Linear  Matrix  Inequalities  (LMIs).  As  the  system  matrices  are  allowed  to  be  time- varying,  the  algorithm  can 
readily  incorporate  measured  deterministic  parametric  uncertainties.  We  demonstrate  through  an  example 
that  the  robust  adaptive  algorithm  we  develop  leads  to  much  improved  transient  behavior  than  the  standard 
adaptive  Kalman  filtering  algorithm.  We  will  see  that  as  a  by-product  of  our  filtering  algorithm,  we  obtain  a 
method  to  optimally  initialize  any  recursive  filtering  algorithm,  for  instance  the  standard  adaptive  Kalman 
filter.  While  convergence  of  the  recursive  algorithm  that  we  present  is  not  guaranteed  in  general — as  with  the 
standard  recursive  Kalman  filter  for  time-varying  systems — we  prove  convergence  in  the  steady  state,  when 
applied  towards  estimation  in  a  linear  time-invariant  system  affected  by  stochastic  uncertainties,  provided 
the  uncertain  system  is  mean  square  stable. 


7.3,2  Problem  setup 

We  consider  the  linear  time- varying  system 


x(k  +  1)  =  AA(k)x(k)  +  BA(k)w(k)} 
y(k)  =  CA(k)x(k)  +  DA(k)w(k),  z(k)  =  L(k)x(k), 


(7.29a) 


where 

m  m 

AA(k)  =  A{k)  +  J2MmSi(k), 

i=l 
m 

c±(k)=c(k)+j2c?(k)a(k), 

*= i 

which  contains  stochastic  parametric  uncertainties, 
adaptive  filter  of  the  form  given  in  (2)  with  z(k)  = 

L(k)  —  I  corresponds  to  state  estimation.)  Specifically,  since  at  each  k  the  correlation  of  the  state  X(k) 
depends  on  the  correlation  of  the  initial  condition  X(0),  X(k )  is  uncertain  when  X(0)  is  uncertain.  We  wish 
to  find  the  optimal  Kalman  gains  K(k  —  1)  and  F(k )  so  as  to  minimize  the  maximum  value  of  the  mean 
square  of  the  estimation  error,  E  [|| z(k)  —  i(Ar)||2],  over  all  allowable  values  for  X(k). 


a*  (*)  =  *(*)  +  2>;  wen*), 


»=i 


(7.29b) 


DA(k)  =  D(k)+j2Dt(k)<:nk), 


1=1 


Our  objective  is  to  design  a  worst-case  optimal  robust 
L(k)x(k\k)  to  estimate  z(k)  (see  Fig.  7.3).  (The  case 


7.3.3  Robust  adaptive  Kalman  filtering 

We  begin  by  rewriting  equations  (7.29)  in  an  equivalent  form  (see  for  example  [MC88,  CC94]).  Let 

m  /  m  \ 

vx{k)  =  +  B{k)  +  Y,Bi{k)Q{k)  w{k) 

1=1  \  1=1  / 

2 Our  framework  is  perhaps  related  closest  with  the  one  in  [CC94],  where  the  “uncertainties”  affect  the  noise  moments;  a 
game- theoretic  argument  is  used  to  establish  the  existence  of  an  optimal  recursive  scheme.  Another  approach  to  solve  this 
problem  is  to  include  the  uncertain  parameters  in  the  state  vector  and  use  Extended  Kalman  Filtering  (EKF)  algorithm. 
Extended  Kalman  filter  is  an  approximate  filter  based  on  the  first-order  linearization  of  the  nonlinear  system  and  is  in  general 
biased  [Men95,  Lju79].  The  order  of  the  filter  depends  on  the  number  of  uncertain  parameters. 


88 


Figure  7.3:  Block  diagram  describing  the  estimation  framework 


«»(*)  =  £<?/(*)#(* )*(*)  +  D(k)  +  £  Dt(k)Ct(k)  w(k). 

i=i  V  1=1  / 

and  Uy  are  random  processes.  Since  £/,  i  =  and  are  independent  zero-mean  white-noise 

processes,  vx  and  vy  satisfy  the  following  first  order  and  second  order  moment  conditions  for  every  k  E  Z+: 

E[vx(k)]  =  0,  £[t>y(fc)]  =  0, 

m 

£■  [v,(k)vx(k)T]  =  B(k)B(k)T  +  £  (. Ai(k)X(k)Ai(k)T  +  Bt(k)Bt(k)T) , 

1  =  1 
m 

E  K(*)^(fc)T]  =  D(k)D(kf  +  £  (C/(*)X(*)C?(fc)T  +  Dt(k)Dt(kf)  , 

1  =  1 
m 

E  M*K(*)T]  =  +  £  (^(fc)X(fc)C/(fe)T  +  B*(k)D‘(k)T)  , 


E  =  D(k)B(kf  +  £  (C?(k)X(k)At(k)T  +  DtWBXkf)  , 

1=1 

where  X(k)  =  £  [z(&)z(/;):r] .  We  also  note  that  vx  and  vy  are  white-noise  random  processes,  so  that  when 
i  ^  j ,  E  [vx(i)vx(j)T]  =  0,  E  [vy(i>j/(i)T]  =  0  and  E  [vx(i)vy(j)T]  =  0*  In  addition,  E  [x(i)vx(j)T]  =  0 
and  E  [s(i)vy(i)T]  =  0  for  i  <  j .  Therefore,  system  (7.29)  can  be  represented  equivalently  as 

x(k  +  1)  =  A(k)x(k)  +  B(k)v(k ),  y(i)  =  C(i)ar(Jb)  +  ^(Jb)v(Jb),  z(Jb)  =  L(k)x(k),  (7.30) 

where 

B(k)  =  [  A{(k)X(ky/*  ...  A’m{k)X{k)W  B(k)  B[(k)  ...  Bsm(k)  ] 


D(k)  =  [  Ci(k)X(k)1/*  . . .  C£,(*)*(*)1/a  D(k)  D[{k)  . . .  Dsm(k)  ]  , 

v  is  a  zero-mean  unit- variance  white  noise  random  process. 

If  the  variance  X(0)  =  E  [x(0)x(0)T]  is  known,  then  it  is  easily  verified  that  X(fc)  can  be  uniquely 
determined  by  the  following  recursion: 


X(k  +  1)  =  h(X(k))  =  A(k)X(k)A(k)T  +  B(k)TB(k ) 

m 

+  £  {A){k)X{k)A]{k)T  +  B? (k)Bj(k)T)  . 

3  =  1 


(7.31) 


However,  X(0)  is  usually  not  known.  In  our  setting,  X(0)  is  assumed  to  lie  in  a  polytope  CoXi(0), . . . ,  Xp(0). 
In  this  case,  it  can  be  easily  shown  that  X(k)  also  lies  in  a  polytope  CoXi(k), . . . ,  Xp(k ),  where 

'  ‘  m 

Xi(k  +  1)  =  A(k)Xi(k)A(k)T  +  B(k)B(k)T  +  £  (Ai(k)Xi(k)A}(k)T  +  B]{k)B‘{k)T )  .  (7.32) 

i=1 
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If  the  system  is  mean  square  stable,  the  poly  tope  converges  to  a  fixed  point  as  k  — ►  oo. 

While  (7.30)  is  similar  to  the  setting  for  the  standard  recursive  Kalman  filtering  problem,  we  note  that 
the  noise  *;(£)  is  state- depen  dent  and  its  second  moment  is  uncertain.  For  this  reason,  the  optimal  linear 
recursive  MMSE  filter  design  problem  is  considerably  harder  than  the  standard  Kalman  filtering  problem, 
which  can  be  solved  analytically  [Koc79].  In  particular,  at  each  k)  we  are  given: 

(Nl)  Measurements  of  the  system  matrices  A(k)}  B(k ),  C(k),  D{k)  and  L{k). 

(N2)  Measurement  of  the  noisy  output  y(k). 

(N3)  From  (7.32),  the  vertices  X\ (&),  . . . ,  Xp(k)  of  the  polytope  where  X(k)  lies  in. 

We  then  need  to  solve  the  following  minimax  optimization  problem  for  the  optimal  Kalman  gains  K(k  —  1) 
and  F(k)  that  determine  the  filter  (2): 

Minimize:  E  [||z(fc)  —  £(&)||2] 

Subject  to:  Data  (N1-N3),  (7.33) 

Equations  (2)  and  (7.30). 

Our  approach  towards  the  solution  of  Problem  (7.33)  is  as  follows:  We  will  first  define  an  upper  bound 
on  the  objective  function,  i.e.,  the  mean  square  of  the  estimation  error  over  all  possible  values  for  the 
corresponding  state  correlation  matrix  X(k).  We  will  then  reformulate  the  problem  of  determining  K(k  —  1) 
and  F(k)  so  as  to  minimize  this  upper  bound  as  a  convex  optimization  problem. 

We  now  proceed  with  deriving  an  upper  bound  on  the  objective  function  of  Problem  (7,33).  Suppose 
that  at  each  k ,  we  have  available  a  matrix  P(k  —  1)  with 

P(k  -  1  )>E  [(*(*  -  1)  -  x(k  -  l|i  -  2  ))(*(*  -  1)  -  x(k  -  1|*  -  2))T]  . 


Then, 

E  [(*(&)  —  x(fc|fc  —  l))(x(fc)  —  £(&|&  —  1))T] 

<  (A(k  -  1)  +  I<{k  -  1)C(*  -  l))P(k  -  l)(A(jb  -  1)  +  K(k  -  1  )C(k  -  1))T 

+(B(k  -  1)  +  I<(k  -  1  )D(k  -  1  ))(B(k  -  1)  +  K{k  -  1  )D{k  -  1))T  (7.34) 

=  f(P(k-l),X(k-l)).  (7.35) 

Then,  we  can  obtain  P(k)  >  E  [(a;(A:)  -  a;(&|A:  -  l))(x(^)  -  x(k\k  -  1))T] ,  simply  by  requiring  that 

f(P(k-l),X(k-l))<P(k),  VX(k-l)eCoXi(k-l),...,Xp(k-l).  (7.36) 


Next,  we  have 

E  [(x(^)  —  x(k\k))(x(k)  —  x(fc|fc))T] 

<  (/  +  F(k)C(k))P(k)(I  +  F(k)C(k))T  +  ( F(k)D(k))(F(k)D(k))T 

=  9(F(k),X(k)). 

Then,  for  any  matrix  M(k )  that  satisfies 

g(F(k),X(k))  <  M(k),  X(k)  =  h(X(k  -  1)), 

VX(k  —  1)  G  CoXi(k  —1), . . . ,  Xp(k  —  1), 

we  have 

E  [( z(k )  -  z(k))(z(k)  -  z(k))T ]  <  L(k)M(k)L(k)T , 


(7.37) 

(7.38) 

(7.39) 
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which  implies  that  Tr (L(k)M(k)L(k)T)  is  an  upper  bound  of  the  objective  function  in  (7.33). 

We  can  now  formulate  the  problem  of  determining  I<(k  -  1)  and  F(k)  so  as  to  minimize  an  upper  bound 
on  the  the  mean  square  of  the  estimation  error  over  all  possible  values  for  the  corresponding  state  correlation 

matrix  as  follows:  ^ 

Minimize :  Tr  (L(k)M(k)L(k)T) 

(7-4°) 

Subject  to:  Conditions  (7.36)  and  (7.39), 

where  P(k ),  M(k ),  I<(k  -  1)  and  F(k)  are  optimization  variables.  While  this  minimax  problem  has  no 
analytical  solution  in  general,  we  establish  via  the  following  theorem  that  problem  (7.40)  is  a  convex  op¬ 
timization  problem,  which  can  be  reduced  to  minimizing  a  linear  objective  subject  with  Linear  Matrix 
Inequality  (LMI)  constraints.  This  problem  can  be  solved  numerically  very  efficiently  using  standard  algo¬ 
rithms  [NN94,  GN95,  GDN95,  WB96],  so  that  Theorem  13  provides  for  the  efficient  and  effective  numerical 
solution  of  problem  (7.40);  for  details  on  LMIs,  we  refer  the  reader  to  the  book  [BEFB94]  and  the  references 
therein. 

Theorem  13  The  minimax  problem  (7.40)  is  equivalent  to  the  following  LMI  optimization  problem  with 
variables  M(k)  =  M(k)T  £  Rnxn,  Q(k)  =  Q{k)T  £  Rnxn,  Y(k)  £  Rnxny  and  F(k)  £  Rnxn*, 

Minimize:  Tr  (L(k)M(k)L(k)T) 


Subject  to: 


Q(k)  Tn(k  -  1 

T13(k  -  1)T  Q(k  -  1) 
Ti3,i(k  -  1)T  0 

M(k)  I  +  F(k)C 

I  +  C(k)TF(k)T  Q(k ) 

Di(k)TF(k)T  0 


Tn(k  -  1)  T13ii(k  -  1)  ' 
Q(k  -  1)  0 

0  1 

I  +  F(k)C(k)  F(k)Di(k ) 
Q(k)  0 

0  I 


>  0,  Q{k)  >  0, 


>0,  i=l,...,p, 


(7.42) 


T12(k  -  1)  =  Q(k)A(k  -  1)  +  Y(k)C(k  -  1), 

Ti3,,(fc  -  1)  =  Q{k)Bi{k  -  1)  +  Y(k)Di(k  -  1). 

(7.42) 

&■(*)=  [  A[(k)Xi(ky/2  ...  A‘m{k)Xi{k)^  B(k )  B{{k)  ...  B‘m(k)  ]  , 

Di(k)  =  [  cmxm1'2  •••  Csm{k)Xi{k)^  D(k)  D{(k)  ...  D’m(k)], 

Xi(k)  is  defined  in  (7.32),  P(k)  —  Q(k)-1  and 

P(k)  >  E  [(z(fc)  -  x(k\k  —  l))(x(k)  -  x(k\k  —  1))T] 

for  any  X(k  -  1)  £  CoXi(k  -  1), . . . ,  Xp(k  -  1),  I<(k  -  1)  =  Q(k)~1Y(k)  and  F(k)  are  the  optimal 

Kalman  gains ;  and  the  upper  bound  of  the  mean  square  of  the  estimation  error  E  [||z(Ar)  —  £(&)||2]  is 

Tr  (L(k)M(k)L(k)T). 

Proof:  Let  X(k  -  1)  =  A,Xj(&  ”  l)i  where  A;  £  [0,1]  and  Y%=i  =  1-  Since  h(X(k  -  1))  is  a 

linear  function  in  X(k  -  1),  we  have  X(k)  =  ^iXi(k)  for  the  same  set  of  A,*,  i  =  1, . .  ,,p.  By  Schur’s 
complements  lemma,  condition  (7.36)  is  equivalent  to 


Tl2(k-  1)T  P(*-l)“ 

•  *  _  ,  -  .  ^  rn  _  . 


Tn(k  -  1)  T13ii(k  -  1  )Xi 


Tl3,i(k-\yXi 


(7.43) 


and  condition  (7.39)  is  equivalent  to 


■  p  r  M(k)- 

I  +  C(k)TF(k)T 
f=i  L  Di{k)T F(k)T Xi 


I  +  F(k)C(k)  F{k)Di(k)Xi 
P(k)~l  0 

0  X} 


(7.44) 
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where  X{  —  diag.X,-^)1/2,  •  •  • ,  Xi(k)1^2, 

Defining  new  variables  Q(k)  —  P{k)~l  >  0  and  Y(k)  —  Q(k)K(k  —  1),  it  is  straight  forward  to  verify 
that  conditions  (7.43)  and  (7.44)  are  equivalent  to  the  LMI  constraints  in  (7.41),  concluding  the  proof.  □ 
Theorem  13  paves  the  way  for  a  recursive  robust  Kalman  filtering  algorithm.  To  start  the  algorithm, 
we  need  to  initialize  Q(0),  the  process  which  we  describe  next.  Let  Xj (0)  =  0.3  Then  we  have  Q(0)  = 
E  [z(0)x(0)T]_1  =  X(0)-1,  where  X(0)  €  CoXi(O), . .  ,,XP(0).  Using  Theorem  (13),  Q(l)  can  be  computed 
as  an  optimizer  to  the  following  problem: 


Minimize:  Tr(L(l)M  (1)L(1)T) 

Subject  to: 

'  Q(l)  Ti2(0)  Ti3,i(0) 

Ti2(0)t  X(O)-1  0 

Ti3,,(0)T  0  / 


>0,  Q(l)  >0 


r  m{  i) 

I  +  C(l)TF(l)T 
Di(l)TF(l)T 
X(0)  eCoX^O),.. 


I  +  F(l)C(l)  F(1)A(1)  ' 

Q(  1)  0 

0  I 

,XP(0),  i=l,...,p. 


>0, 


(7.45) 


The  matrix  inequalities  in  (7.45)  are  not  linear  in  all  the  variables,  because  the  first  LMI  constraint  has  the 
term  X(O)”1.  However,  it  is  easily  shown  that  (7.45)  is  equivalent  to  the  LMI 


Minimize :  Tr(L(l)M(l)L(l)T) 

Subject  to: 

Q{  1)  712(0)1^(0)  Ti3,,(0) 

X,(0)7f2(0)  Xf(0)  0 

Ti3,i(0)T  0  I 


>o,  g(i)>o, 


M(l) 

Z  +  C(1)tF(1)t 

.  Di(l)TF(l)T 


I  +  ir(l)C(l) 

<?(1) 

0 


F(1)A(1) 

0 

I 


>  0, 


X(0)  €  CoXi (0), . . . ,  Xp(0),  i  =  1 , . . . ,  p, 


(7.46) 


where  Ti2(0),  Ti3i,(0),  A(l)  are  defined  in  (7.42),  and  K( 0)  =  Q(l)  Jy(l). 


Remark  7.3.1  The  solution  to  the  optimization  problem  (7-45)  can  also  be  applied  towards  “ optimally ” 
initializing  other  recursive  algorithms,  for  instance  the  standard  adaptive  Kalman  filtering  algorithms,  with 
an  attendant  improvement  in  transient  performance  of  such  routines . 


We  now  summarize  the  various  steps  in  our  robust  adaptive  Kalman  filtering  algorithm: 


Step  1.  Solve  (7.46)  to  initialize  Q(  1),  M(  1),  K( 0)  and  F(l).  Let  k  =  1. 

Step  2.  At  time  fc  +  1,  let 

Xi(k  +  1)  =  A(k)Xi(k)A(k)T  +  B{k)B{k)T 

m 

+  YJ{A*{k)Xi{k)A‘{k)T  +  Bj  (k)Bj  (k)T) , 

3  =  1 

Step  3.  Solve  the  eigenvalue  minimization  problems  (7.41)  for  Q(k)y  M(k)  and 
Step  Repeat  Steps  2  and  3.  • 

3If  E[x{0)}  =  a  is  known  and  a  ^  0,  we  may  define  27^(0)  =  a  and  Q(0)  becomes  (A(0)  —  aaT)~ 1.  The  initialization 
process  (7.46)  can  still  be  applied  by  replacing  X(0)  by  X  (0)  —  aaT  and  A,(0)  by  A,(0)  —  aaT  respectively. 


i= 


(7.47) 


I<(k  -  1),  F{k). 
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We  have  the  following  observations  on  the  robust  Kalman  filtering  algorithm: 

1.  If  the  correlation  X(0)  is  exactly  known  in  advance,  the  polytope  is  a  fixed  point  at  each  k.  The  eigen¬ 
value  minimization  problem  (7.41)  turns  out  to  be  equivalent  to  the  optimization  problem  encountered 
in  the  standard  adaptive  Kalman  filtering  problem,  and  can  be  solved  analytically. 

2.  If  we  have  xj( 0)  =  E'fa^O)]  in  estimator  (2),  then  it  can  be  readily  checked  that  the  state  estimation 
algorithm  is  unbiased. 

3.  If  system  (7.29)  is  mean  square  stable  and  the  state-space  matrices  (the  matrices  on  the  right-hand 
sides  of  (7.29b))  are  constant,  then  the  state  estimation  using  robust  adaptive  Kalman  filter  converges 
to  a  steady  state  estimator;  a  proof  is  given  in  Section  7.5. 


7.3.4  A  numerical  example:  Adaptive  equalizer  for  communication  channels 

We  present  an  application  of  the  proposed  robust  adaptive  Kalman  filtering  techniques  towards  the  design 
of  equalizers  for  a  communication  channel.  Consider  the  following  IIR  model  of  a  communication  channel 


Xi(k  +  1) 

'  0.9 

0.5  ' 

zi(fc) 

| 

'  1  ‘ 

x2(k  +  1)  _ 

0 

0.9  _ 

.  *2(k)  . 

1 

1 

y(k)  =  [l  +  C(k)  1 +  <(*)] 


*i(fc) 
x2(k)  J 


s(k), 


+  (5  +  ((k))s(k)  +  w(k). 


(7.48) 


s  is  the  signal  which  is  transmitted  through  the  channel,  w  is  the  — 10  dB  white  noise  that  corrupts  the 
received  signal  y.  The  channel  model  (7.48)  is  affected  by  time- varying  uncertainties  £  that  are  a  combination 
of  mixed  deterministic  and  stochastic  parametric  uncertainties  (see  for  example,  [MC88]).  Specifically,  £(&)  = 
0.1Cd(fc)-j-0.5£5(&),  where:  Crf(^)  1S  deterministic,  satisfies  |Cd(&)|  <  1  for  all  fc,  and  can  be  measured  in  real¬ 
time;  £,  is  a  zero-mean  white  noise  process  with  a  unit  variance,  and  is  independent  of  w  and  s.  The 
initial  conditions  of  the  state  vectors,  £i(0)  and  £2(0),  are  random  variables  and  satisfy  the  second  moment 
conditions 


£M0)*i(0)]<l,  E[x2( 0)z2(0)]<1,  E[xx{ 0)*2(0)]  =  0,  ^N0)^(0)]  =  0. 

For  the  channel  (7.48),  we  design  an  equalizer  to  estimate  the  input  signal  s(k)  (Fig.  7.1). 

Assuming  a  zero  mean,  uncorrelated  white  noise  model  for  the  input  signal  s,  we  design  an  equalizer 
using  the  robust  adaptive  Kalman  filtering.  The  first  case  considered  is  when  the  channel  does  not  have 
any  uncertainty,  i.e.,  ,£<*  =  £,=();  this  is  the  ideal  channel,  and  the  corresponding  equalizer  is  a  standard 
adaptive  Kalman  filter.  In  Fig.  7.4,  we  compare  the  standard  Kalman  filter  with  optimal  initialization 
(obtained  by  solving  (7.46)),  with  the  standard  Kalman  filter  with  an  ad  hoc  initialization  scheme  [Men95] 
(P(0)  =  77/,  where  77  —  0.1, 1  and  10).  The  Mean  Square  Error  (MSE)  estimates  are  obtained  by  averaging 
200  runs.  The  results  indicate  that  the  transient  performance  of  the  standard  Kalman  filtering  algorithm 
can  be  improved  by  solving  (7.46)  to  optimally  initialize  the  recursion. 

In  the  second  example,  we  compare  the  performance  of  the  standard  Kalman  filtering  algorithm  and 
the  proposed  robust  adaptive  Kalman  filtering  algorithm  in  the  presence  of  uncertainties;  Fig.  7.5  shows 
a  comparison  of  the  experimentally  obtained  mean  square  error  values,  averaged  over  200  runs,  obtained 
with  the  standard  adaptive  Kalman  filter  with  optimal  initialization  by  solving  (7.46),  and  our  robust 
adaptive  Kalman  filter.  It  is  clear  that  the  the  adaptive  Kalman  filtering  techniques  presented  herein  offer 
significantly  improved  estimation  performance  over  the  standard  adaptive  Kalman  filter  in  the  presence  of 
stochastic  parametric  uncertainties. 

7.4  Conclusion 

First,  we  have  developed  robust  minimum  mean  energy  gain  (MMEG)  and  asymptotic  minimum  mean  square 
error  (MMSE)  filtering  algorithms  for  systems  with  mixed  deterministic  and  stochastic  uncertainties. 

Secondly,  we  have  developed  a  robust  adaptive  Kalman  filtering  algorithm  for  linear  time- varying  systems 
with  stochastic  parametric  uncertainties.  If  the  system  is  mean  square  stable  and  the  state-space  matrices 
are  time-invariant,  we  have  established  that  the  robust  adaptive  filter  converges  to  a  steady  state  estimator. 
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Figure  7.4:  Illustration  of  the  performance  improvement  of  the  standard  Kalman  filter  with  optimal  initial¬ 
ization 


The  filtering  algorithm  is  formulated  as  an  optimization  problem  based  on  linear  matrix  inequalities,  and 
can  be  implemented  numerically  efficiently. 

We  have  illustrated,  via  numerical  examples,  the  application  of  these  filtering  techniques  towards  design¬ 
ing  equalizers  for  communication  channels. 

7.5  Appendix:  Proof  of  the  convergence  of  the  robust  adaptive 
Kalman  filtering  algorithm 

Proposition  3  Let  A  £  Rnxn,  B  £  Rnx,,“,  C  £  Rn»xn,  and  D  £  R”*™".  Suppose  that: 

1.  A  has  all  of  its  eigenvalues  inside  the  unit  disk. 

2 .  DDt  >  0. 

3.  The  Riccati  equation 

P  =  APAt  +  BBt  -  ( BDt  +  APCt)(CPCt  +  DDt)~1(DBt  +  CPAt)  (7.49) 

has  a  unique  positive  semidefinite  solution  P* . 

The  matrix  K*  defined  by 

K*  =  -( AP*Ct  +  BDt)(CP*Ct  +  DDt)~ 1 

satisfies 

(I<* D  +  B)(K*  D  A  B)t  >  0. 

Under  these  conditions ,  consider  the  following  recursion: 

P*(k  -f  1)  =  min  f(P*(k)}  K(k)), 4  and  K*(k)=  argmin  f(P*(k)}  K(k))}  (7.50a) 


4 Though  the  set  of  positive  semidefinite  matrices  is  only  a  partially  ordered  set,  it  is  well-known  that  the  problem 
min/v'(fc)  f(P*(k)iK(k))  is  well  defined;  see  [Koc79]. 
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Figure  7.5:  Performance  comparison  between  the  robust  and  standard  Kalman  filters 


where 

f(P( k),  I<(k))  =  (A  +  I<(k)C)P(k)(A  +  K(k)C)T  +  ( K(k)D  +  B)(I<(k)D  +  B)T .  (7.50b) 


Then ,  for  any  initial  condition  P( 0)  >  0,  the  sequence 
satisfies 


lim  P*(k)  =  P*  and 

Jc—oo 


of  solutions  {P*(k),I<*(k)}  to  the  recursion  (7.50) 
lim  K*(k)  =  I<*. 


Remark  7.5.1  Condition  (2)  is  a  standard  assumption  with  Kalman  filtering,  see  for  example  [Koc79, 
Men95,  GKN+74]. 

For  the  special  case  BT D  =  0,  the  solution  of  the  recursion  (7.50)  yields  the  standard  recursive  Kalman 
filter;  see  for  example  [Koc79,  Men95,  GKN+74]-  In  this  case,  conditions  (3)  and  (4)  in  the  theorem 
statement  are  automatically  satisfied. 

Condition  (4)  ensures  that  A  +  Ii*C  is  stable. 

Proof:  Let  P(0)  >  0  be  a  given  initial  condition.  The  proof  of  the  theorem  consists  of  the  following  steps. 

1.  Let  {P((k),K((k)}  and  {P£(k),  K^k)}  be  two  sequences  consisting  of  the  solutions  of  (7.50)  for  two 
different  initial  conditions.  If  P({ko)  >  P^ko),  then  P((k)  >  P^ik)  for  any  k  >  ko- 

This  follows  inductively  from 

P2’(fc0  +  1)  =  f(Pl(k0),iq(k0))  <  f(P!(ko),K Uko)) 

<  f(P((ko),iq(ko))  =  P((ko  +  1). 

2.  Let  {P*(k),  K*(k))  be  the  sequence  consisting  of  the  solutions  of  (7.50)  for  an  initial  condition  P{ 0)  > 
0.  Then,  {P*(&)}  is  bounded. 

Since  A  is  stable,  the  sequence  {P(fc)}  obtained  via  the  recursion 

P(0)  =  P(0);  P(k  +  l)  =  f(P(k),0) 
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is  bounded.  (Indeed  this  sequence  converges  to  the  controllability  Gramian  of  (A,  B).)  Next, 

p*(  i)  =  /(P(o),/r(o))  <  /(p(o),o)  =  p(i), 

p*t 2)  =  /(P+(1),A-(1))</(P*(1),0)</(P(1),0)  =  P(2). 

Inductively,  we  get  P*(k)  <  P(k).  Therefore  the  sequence  (P*(&)}  is  bounded. 

3.  The  sequence  of  solutions  {P0*(fc),  .Kq  W)  obtained  by  solving  (7.50)  with  P(0)  =  0  satisfies  P0*(fc-t-l)  > 
P0*(Ar),  k  e  Z+,  with  lim*_>oo  P0*(&)  =  P*- 

First  note  that  Pq  (1)  >  P(0)  =  0.  Next,  define  P*(k)  =  Pq  (k  +  1)  and  K*(k )  —  K${k  +  1), 
k  =  0, 1, 2, . . ..  Then,  clearly  {P*(fc),  7f*(&)}  is  a  sequence  consisting  of  the  solutions  of  (7.50)  for  the 
initial  condition  P(0)  =  Pq(1).  Since  P(0)  >  Po(0)  =  0,  an  application  of  Step  1  of  the  proof  yields 

P*{k)  >  PS(k)t  or  Pq  (k  +  1)  >  P0*(*),  ^  =  0, 1,  2, _  From  Step  2,  the  sequence  {Pq  (k)}  is  bounded, 

and  therefore  converges  to  some  limit  P.  Since  P  >  0,  and  satisfies  (7.49),  P  =  P*. 

4.  Given  any  p  >  0,  there  exists  P( 0)  >  pi  such  that  the  resulting  sequence  of  solutions  {P*(k),  K*(k)} 
of  (7.50)  satisfies  P*(k  +  1)  <  P*(k),  k  £  Z+,  with  lim^-^  P*( k)  =  P. 

Since  is  stable,  there  exists  some  Q  >  0  such  that  AQAT  —  Q  +  BBT  <  0  and  Q  >  pi.  Let  P(0)  =  Q. 
We  then  have 

P(l)  =  /(P(0),  IC{ 0))  <  /(P(0),  0)  <  P(0). 

Following  the  same  argument  as  in  Step  (3),  it  is  easily  shown  that  P(k)  is  a  nonincreasing  matrix 
function  of  k.  Since  the  sequence  {P(&)}  *s  bounded  below  by  zero,  it  converges  to  some  limit  P.  Since 
P  >  0,  and  satisfies  (7.49),  P  —  P*. 

Now  for  any  initial  condition  P(0)  >  0,  there  exists  P2(0)  large  enough  such  that  P(0)  <  P2(0).  Let 
(P*(&),  Afj  (A:)}  and  {P£  (&),  (£)}  be  the  sequences  consisting  of  the  solutions  of  (7.50)  for  the  initial 

conditions  Pi(0)  =  0  and  P2(0)  respectively.  Since  both  {Pi(fc)}  and  (P2(&)}  converge  to  P*,  the  sequence 
{P(fc)}  converges  to  P*  as  well.  Convergence  of  { K*(k )}  to  K*  follows  immediately  from  the  observation 
(see  for  example,  [Koc79])  that  P*(&)  and  I<*(k)  are  related  by 

K*(k)  =  —(AP*{k)CT  +  BDT)(CP*(k)CT  +  DDt)~1. 


□ 

Proposition  4  Let  {X(£)}  be  the  sequence  consisting  of  the  solutions  to  the  recursive  equation 

m 

X(k  +  1)  =  AX(k)AT  +  BBt  +  J2  {A-)X{k){A))T  +  B’(B°)t)  ,  k  =  1,2,...,  (7.51) 

i= i 

with  initial  condition  X(0)  >  0,  where  A,  P,  Aj ,  Bj  are  constant  matrices.  The  sequence  {X(&)}  is 
convergent  and  the  limit  is  independent  of  0)  if  and  only  if  there  exists  some  matrix  Q  >  0  such  that 

m 

AtQA  -Q  +  <  o,  (7.52) 

j  =  1 


i.e.,  ,  the  system  is  mean  square  stable. 

Proof:  We  first  show  that  the  sequence  (X(fc)}  obtained  from  (7.51)  is  convergent  and  the  limit  is  inde¬ 
pendent  of  X(0)  if  and  only  if  the  sequence  {A(fc)}  obtained  from 

m 

X(k+l)  =  AX(k)AT  +  Y,AsjX(k){Asj)T  (7.53) 

J  =  1 


is  convergent  and  lim^oo  X(k)  —  0. 

Suppose  the  limit  of  the  sequence  (A(fc)}  exists  and  lim^oo  X(k)  =  0.  For  any  X(0),  define  X(k)  — 
X(k  4-  1)  —  X(k).  It  is  easily  checked  that  X(fc)  satisfies  the  recursion  (7.53).  Since  lim^oo  X(k)  =  0, 
{X(&)}  is  convergent. 


96 


To  show  that  the  limit  of  (A(&)}  is  unique,  suppose  {Xi  (£)}  and  {X2(k)}  are  two  sequences  of  solutions 
to  (7.51)  corresponding  to  two  different  initial  conditions  Xl(0)  and  ^(0),  with  limjfc_oo  X\[k)  —  X\  and 
limjfc_oo  X2(k)  =  X2.  Then,  it  is  easily  verified  that  with  X(k)  =  X\(k)  —  X2 (k),  the  sequence  {X(k)} 
consists  of  solutions  of  the  recursive  equation  (7.53);  then  limjb_,oo  X(k)  =  0  implies  X\  —  X2. 

Now  suppose  the  limit  of  the  sequence  (X(&)}  exists  and  is  independent  of  X(0).  We  show  that 
limjb_>oo  X(k)  =  0. 

For  any  X(0 ),  let  Xi(0)  =  X(0),  X2(0)  =  0  and  {Xi(k)},i  =  1,2  be  the  corresponding  sequences  from 
recursion  (7.51).  By  recursion  (7.53),  we  have  X(k)  =  Xi(k)  —  X2(k).  Since  lim^oo  Xi(k)  =  lim*_>oo  X2(k), 
we  get  limjfc_,oo  X(k)  =  0 . 

Finally,  with  Lemma  7.2.1  that  condition  (7.52)  is  necessary  and  sufficient  for  {X(fc)}  to  converge  to 
zero,  the  statement  in  the  proposition  is  established.  n 

In  the  following,  we  define  limjb—oo  X(k)  =  X, 

B=[A\X  ...  A‘mX  B  B[  ...,B’m  ]  , 

and 

D=[C[X  ...  C^X  D  D[  ...  D‘m  ]. 

Proposition  5  Let  P( 0)  be  given.  Let  {P*(k),  K*(k)}  be  the  sequence  consisting  of  the  solutions  to  the 
optimization  problem  (7.50).  Let  {P*(fc),  K*(k),  F*(k)}  be  the  sequence  consisting  of  the  solutions  to  the 
optimization  problem 

min  Tr(M(£)),  £  =  1,2..., 

K(k~l)tF(k)  v 

where 

f(P(k  -  1),  K(k  -  1))  =  (A  +  I<(k  -  1  )C)P(k  -  l)(A  +  K{k  -  1  )C)T 

+(K(k  -  1  )D  +  B)(I<(k  -  1  )D  +  Bf, 

P(k)  =  f(P(k-l),K(k-l)), 

M{k)  =  (I  +  F(k)C)P(k)(I  +  F(k)Cf  +  F(k)DDTF(k)T, 

and  DDt  is  assumed  to  be  positive  definite. 

Then : 

P*(k)  =  P*(k)  and  I<*(k)  =  /?*(£),  1,2,.... 


(7.54a) 

(7.54b) 

(7.54c) 

(7.54d) 


Proof:  Starting  with  the  sequence  {P*(&),  K*(k)}  consisting  of  the  solutions  to  the  optimization  prob¬ 
lem  (7.50),  it  is  clear  that 

P*(k)  =  P*(k)  and  I<*(k)  =  K*(k),  k=  1,2,..., 

must  be  (possibly  nonunique)  optimizers  for  problem  (7.54)  (this  follows  immediately  from  the  equation  (7.54d)). 
Thus,  it  remains  to  show  that  P*(k)  =  P*(k )  and  =  I<*(k )  are  the  only  candidates  as  optimizers  for 

problem  (7.54).  In  other  words,  it  suffices  to  show  that  for  a  given  P*(k  —  1),  the  optjmal  solutions  P*(k) 
and  K*(k )  in  (7.54)  are  unique.  However,  note  that  given  P*(k  —  1)  and  K*(k  —  1),  P*(k)  is  given  simply 
as  f(P*(k  —  1), K*(k  —  1)),  thus  we  only  need  to  show  that  given  P*(k  —  1),  K*(k  —  1)  that  solves  (7.54)  is 
unique. 

Now,  let  {P*(k)}  K*(k),  F*(k)}  be  the  sequence  consisting  of  the  solutions  to  the  optimization  prob¬ 
lem  (7.54).  Assuming  an  optimal  value  for  P(k  -  1),  we  consider  the  optimization  problem  (7.54).  For 
convenience,  we  introduce  new  notation  for  M(k): 

g(I<(k  -  1),  F(k))  =  (I  +  F(k)C)f(P(k  -  1),  I<(k  -  1 ))(/  +  F(k)C)T  +  F(k)DDT F(k)T . 

We  also  denote 

gopt(K(k  -  1))  =  min £?(/!'(*:  -  1),  F(k)) 
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and 


Fopt(K(k  -  1))  =  arg»n  g(I<(k  -  1),  F(k)). 

Note  that  F*{k)  =  Fopt(K*(k  -  1)). 

Now  for  any  P{k )  =  f(P(k  -  l),K(k  -  1))  >  0,  since  ( CP{k)CT  +  DDT)  >  0,  it  can  be  easily  verified 
that  if  F(k)  ^  Fopt{K(k  -  1)),  then 

g(I<(k  -  1),  F(k))  >  g(I<(k  -  1),  Fopt(I<(k  -  1))) 

and 

g(I<(k  -  1),  F(k))  ±  g(K(k  -  1),  Fopt(I<(k  -  1))). 

Therefore 

Tr (g(K(k  -  1),  F(k)))  >  Tr (g(I<(k  -  1),  Fopt(I<(k  -  1)))). 

Thus,  Fopt(K(k  —  1))  is  uniquely  determined  from  K(k  —  1). 

To  show  that  I<*(k  -  1)  is  unique,  it  suffices  to  show  that  for  any  I<(k  -  1)  ^  K*(k  —  1),  Tr(g(I<(k  — 
l),Fopt(I<(k-  1))))  >  Tr(g(I<*(k  -  l),Fopt(K*(k  -  1))).  Let  Pj(fc)  =  f{P(k  -  1  ),K(k  -  1))  and  P2(k)  = 
f(P(k  -  1),  I<*(k  -  1)).  Then  we  have  Pi(k)  >  P2{k)  and  Pi(k)  ±  P2(k).  Then,  we  consider  two  cases: 

1.  If  Fopt(K{k  -  1)))  #  Fopt(K*(k  -  1)),  then 

g(K(k  -  1),  Fopt(K(k  -  1)))  >  g(K*(k  -  1),  Fopt(K*(k  -  1))) 

and 

g(K(k  -  1),  Fopt(K(k  -  1)))  #  g(K*(k  -  1  ),Fopt(lC(k  -  1))). 

Therefore 

Tr(g(I<(k  -  1),  Fopt(I<(k  -  1))))  >  Tr(g(K*(k  -  1),  Fopt(K*(k  -  1)))). 

2.  If  Fopt(I<(k  -  1))  =  Fopt(K*(k  -  1)),  then 

P1(k)CT(CP1(k)CT  +  DD7')-1  =  P2(k)CT(CP2(k)CT  +  DDt)~\ 

After  simple  manipulations,  we  get 

DDT{CP1(k)CT  +  DDt)~1  =  DDT(CP2(k)CT  +  DDT)~1. 

Since  DDT  >  0  and  P\{K)  >  P2(I<),  we  have  C{P\{k)  -  P2(k))  =  0.  By  (7.54d),  this  implies  that 
Tr(g(I<(k  -  l),Fopt(I<(k  -  1)))  >  Tr(g(I<*(k  -  1  ),Fopt(I<*(k  -  1)))). 

This  completes  the  proof.  D 

Now  we  are  ready  to  show  that  the  robust  Kalman  filtering  algorithm  is  convergent. 

Theorem  14  Consider  the  state  estimation  problem  (L  =  I)  of  system  (7.29),  with  all  the  state-space 
matrices  being  time  invariant  and  DD ^  being  positive  definite.  The  robust  adaptive  Kalman  filtering  algo¬ 
rithm  converges  to  a  steady  state  LTI  estimator,  i.e ,  for  any  P( 0)  >  0,  we  have  lim^oo  P*(k)  =  P*, 
lim^oo  I<*(k)  =  K*f  and  lim*^  F*(k )  =  F*  if: 

1.  There  exists  Q  =  QT  with  Q  >  0  such  that 

m 

AtQA  -  Q  +  J2(aj)tQ(asj)  <  °*  (7-55) 

i=i 


2.  The  Riccati  equation 

P  =  apat  +  BBt  -  ( BDt  +  APCt)(CPCt  +  DDt)-\DBt  +  CPAt ) 


has  a  unique  positive  semidefinite  solution  P* , 


and  the  matrix  K*  defined  by 


K*  =  ~(AP*Ct  +  BDT)(CP*CT  +  DDt)~1 


satisfies 

(K* D  +  B)(I<* D  +  B)t  >  0. 
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Proof:  With  all  the  state-space  matrices  in  system  (7.29)  being  time  invariant,  we  have  A{k)  =  A ,  B(k )  =  B 
and 

B(k)  =  [  A\X{k)V2  . . .  A^X(k)1/2  B  Bt  ...  B‘m  ]  , 

D(k)  =  [  CiXih)1'2  ...  C'mX{kf I2  D  D[  ...  D*m  ]. 

The  correlation  of  the  state  X(k)  =  E  [x(k)x(k)T]  satisfies  the  recursion 

m 

X(k  +  1)  =  AX(k)AT  +  BBt  +  j£/  (AjX(k)(Aj)T  +  5?(Bj)T) ,  k  =  0, 1, . . .. 

i= i 

By  Proposition  4,  we  have  lim^—oo  X(k)  =  X,  where  X  is  unique  and  independent  of  the  initial  condition 
X(0)€CoXi(0),...,Xp(0). 

With  limjt_oo  B(k)  =  B  and  lim*_oo  D(k)  =  D,  we  now  define  another  set  of  recursive  equations 


min  Tr(  M(k)),  (7.56a) 

K(k-l),F(k) 

f(P(k  -  1),  I<(k  -  1))  i  (A  +  I<(k  -  1  )C)P(k  -  1)(A  +  K(k  -  1  )Cf 

+(I<(k  -  1  )D  +  B)(I<(k  -  1  )D  +  B)t, 

P(k)  =  f(P(k-l)J<(k-l)),  (7.56c) 

M(k)  =  (I  +  F(k)C)P(k)(I  +  F(k)C)T  +  F(k)DDTF(k)T.  (7.56d) 


Using  arguments  similar  to  those  in  the  proof  of  Theorem  13,  we  conclude  that  (7.56)  is  equivalent  to 
the  LMI  problem 


Minimize: 


Tr(M(ifc)) 


Subject  to: 


Q(k) 

(Q(k)A  +  Y  (k)C)T 
(Q(k)B  +  Y(k)D)T 


Q(k)A  +  Y(k)C 
Q(k  -  1) 

0 


Q(k)B  +  Y(k)D 
0 
I 


>0, 


M(k)  I  +  F(k)C  F(k)D 
I  +  CTF(k)T  Q(k)  0 

DTF(k)T  0  J 


>  0,  Q(k)  >  0, 


(7.57) 


where  Q(k)  =  P(k)~1  and  Y(k)  =  Q(k)K(k  —  1). 

Let  K*(k)  and  F*(k)  denote  the  optimal  Kalman  gains  of  (7.56).  From  Proposition  5,  equation  (7.56) 
has  the  same  optimal  solution  of  P(k)  and  K*(k )  as  that  of  equation  (7.50).  From  Proposition  3,  we  have 
limjfc_oo  K*(k)  =  K*  and  (.A  +  K*C )  is  stable.  Thus 


EIK-4+  I<*(k)C)(A  +  K*{k)C)T 

j=i k=j 


<  Ti(P( 0)), 


where' Ti(P(0))  is  a  uniform  bound  over  i  >  0  and  depends  only  on  P( 0). 

f(P(k),K(k))  is  a  continuous  and  strictly  convex  function  of  P(k)  and  K(k).  From  LMIs  (7.35) 
and  (7.57),  it  follows  that  for  any  small  number  c,  there  exists  N,  such  that  whenever  k  >  N,  we  have 

II  f(P(k),  K*(k))  -  f(P(k),  I<*(k))\\  <  T2(P(k))e, 

where  K*(k)  is  the  optimal  solution  of  LMI  (7.41)  and  T2{P{k))  is  a  constant  that  depends  on  P(k).  T2(P(k)) 
is  finite  if  P(k)  is  bounded. 

By  setting  P(N)  =  P(N),  we  get  ||P(7/  +  1)  -  P(N  +  1)||  <  T2(P(N))e.  At  time  N  +  1,  we  have 

|| P(N  +  2)  -  P(N  +  2)||  =  ||  f(P(N  +  1),  I<*(N  +  1))  -  f(P{N  +  1),  I<*{N  +  1))|| 

<  (T2(P(N))\\(A  +  K*(N  +  1)C)(A  +  I<*(N  +  1)C)T||  +  T2(P(N  +  1)))  e. 
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Recursively  for  i  =  2, 3, . . we  get 
|| P(N  +  i)  -  P(N  +  OH 


=  ||  f(P(N  +  i  -  1),  K*(N  +  i  -  1))  -  f(P(N  +  i  -  1),  I<*(N  +  i  -  1))|| 

<  T2(P(N  +  i  -  l))e 

t-1  N+i- 1 

+  T2(P(N  +  j  —  1))  n  (A  +  I<*(k)C)(A  +  K*(k)C)T  e 

j-1  k=N+j 

<  (T2(P(N  +  i-  1))+  max  T2(P(N  +  j))Ti(P(iV))^ )  e. 

\  j=0, — 2  / 

Using  an  argument  along  the  lines  of  Step  (2)  in  Proposition  3,  we  obtain  that  {P(&)}  is  also  bounded, 
with  the  bound  depending  only  on  P( 0).  Therefore,  there  exist  finite  constants  T3(P(0))  and  T4(P(0)),  that 
depend  on  P(0),  such  that  for  any  k  >  0,  Ti(P(k))  <  T3(P( 0))  and  T2(P(^))  <  T4(P(0)).  Thus,  we  conclude 
that  \\P(N  +  i)  —  P(N  +  i) ||  is  bounded  and  that 

||P(AT  +  0  -  HX  +  i)||  <  [T4(P(0))T3(P(0))  +  T4(P( 0))]e. 

Since  c  can  be  arbitrarily  small  when  N  is  large  enough,  we  obtain 

lim  P(k)  —  lim  P(k)  =  P* . 

k-+oo  k-+  oo 

Similar  arguments  establish  that 

lim  K(k)  =  lim  K{ k)  =  K*  and  lim  F(k)  =  lim  F(k)  =  F*. 
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1  Introduction 


The  models  of  control  systems  encountered  in  several  diverse  naval  applications  are  non¬ 
linear;  moreover,  they  are  also  time-varying,  and  have  uncertainties  affecting  them.  The 
underlying  controller  design  problems,  beyond  requiring  system  stability,  also  typically  re¬ 
quire  the  optimization  of  some  performance  objectives.  Ideally,  the  control  law  should  have 
the  properties  that:  (1)  it  adapts  itself  according  to  the  nonlinearities;  (2)  it  can  handle 
several  performance  objectives  (besides  stability)  in  a  uniform  manner;  and  (3)  it  guarantees 
the  performance  of  the  closed- loop  system  in  spite  of  the  variations  and  the  uncertainties. 

The  overall  goal  of  the  project  is  a  numerical  solution  methodology  for  solving  the  general 
nonlinear  controller  design  problem.  Our  approach  is  motivated  by  recent  advances  in  control 
and  optimization  theory  as  well  as  the  sustained  growth  in  the  available  computing  power 
over  the  past  few  years.  The  proposed  controller  architecture  is  gain-scheduled  (i.e.,  the 
controller  uses  the  measured  nonlinearities  and  time- variations),  and  optimizes  the  worst-case 
performance — over  the  uncertainties — of  the  system.  The  search  for  the  optimal  controller 
parameters  can  be  reformulated  as  convex  optimization  problems  involving  linear  matrix 
inequalities  (LMIs)  in  several  important  cases.  The  design  approach  lends  itself  naturally  to 
the  development  of  computer-aided  design  tools,  and  enjoys  the  advantages  of  widespread 
applicability,  ease  of  implementation  and  cost  effectiveness. 

The  progress  achieved  towards  overcoming  some  of  the  technical  roadblocks  was  outlined 
in  the  following  reports: 

•  Progress  report  for  the  period  May  1997  -  October  1997 

•  Annual  report  for  the  period  May  1997  -  April  1998 

•  Progress  report  for  the  period  May  1998  -  October  1998 

Since  then,  efforts  have  been  directed  towards  applying  the  research  results  towards  the 
Basic  Research  on  Intelligent  Information  and  Autonomous  Agents,  and  Applied  Research 
on  Unmanned  Combat  Air  Vehicles ,  directed  by  Dr.  Allen  Moshfegh,  ONR. 

1.1  Gain-scheduled  control  of  the  Texas  A&M  UCAV  models 

The  dynamics  of  Unmanned  Combat  Air  Vehicles  (UCAVs)  undergoing  aggressive  maneuvers 
are  highly  nonlinear  and  time- varying.  One  approach  towards  modeling  UCAVs  involves 
linearizing  the  dynamics  of  the  UCAV  around  various  points  in  the  flight  envelope.  Then, 
the  composite  model  of  the  UCAV  can  be  given  as  a  linear  parameter-dependent  model,  with 
the  parameters  being  the  flight  conditions.  A  comprehensive  effort  towards  identifying  such 
models  is  currently  being  undertaken  at  Texas  A&M  University. 

We  have  directed  research  efforts  towards  a  systematic  design  procedure  for  controller 
synthesis  for  the  linear  parameter-dependent  ONR  UCAV  models.  Traditional  techniques  for 
controller  synthesis  consist  of  designing  a  single  controller  that  is  intended  to  function  across 
varying  flight  conditions.  These  include  constant  state-feedback,  as  well  as  the  celebrated 
LQR/LQG  and  H,*,  controllers.  While  these  control  techniques  can  be  sometimes  proven 
to  work  (i.e.,  stabilize  the  system  or  provide  acceptable  performance),  they  can  be  quite 
conservative,  especially  when  the  flight  conditions  vary  considerably. 
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Gain-scheduled  controller  design  offers  the  potential  much  more  aggressive  control  design. 
The  basic  idea  is  to  synthesize  a  series  of  dynamic  controllers,  one  for  each  linearized  model 
of  the  UCAV  around  a  flight  condition,  and  then  “schedule”  these  controllers  according  to 
the  actual  flight  condition.  An  ad  hoc  implementation  of  such  a  scheme  is  not  guaranteed  to 
work;  however,  it  is  possible  to  develop  a  gain-scheduling  scheme,  using  Lyapunov  functions, 
that  is  guaranteed  to  work  across  various  flight  regimes. 

Another  advantage  of  an  approach  based  on  Lyapunov  functions  is  that  it  can  be  extended 
to  handle  constraints  other  than  mere  stability.  Stability  requires  the  Lyapunov  function  to 
decrease  along  the  trajectories  of  the  parameter-varying  system.  Additional  constraints 
on  the  Lyapunov  function  can  be  used  to  design  controllers  with  guaranteed  performance. 
Examples  of  performance  measures  are  the  energy  in  the  state  vector,  and  peak  values 
of  signals  of  interest;  in  several  instances,  it  is  desirable  that  these  performance  measures 
be  small.  And  gain-scheduled  controllers  that  minimize  upper  bounds  on  these  performance 
measures  can  be  designed.  The  technical  details  behind  synthesizing  improved  gain-scheduled 
controllers  can  be  found  in  [1,  2]. 

The  fore-mentioned  ideas  have  been  integrated  into  Dr.  Moshfegh’s  project: 

The  simulation  results  of  applying  gain-scheduled  control  techniques  on  the  Texas 
A&M  UCAV  models,  preprints  outlining  the  technical  approach,  and  software 
have  been  made  available  on  the  website 

http : //dynamo . ecn . purdue . edu/~ragu/ onr/ gs-cont r . html 
A  snapshot  of  the  web-page  is  shown  in  the  appendix. 

1.2  Robust  estimation 

A  second  research  direction  that  is  relevant  to  Dr.  Moshfegh’s  project  was  identified  during 
the  January  semi-annual  program  review,  held  in  January  1999. 

Estimation  problems  arise  in  many  naval  applications  in  control,  communications  and 
signal  processing  areas.  Traditional  estimation  algorithms  are  usually  based  on  a  nominal 
system  model  without  uncertainty.  However,  in  many  cases,  there  exist  uncertainties  in 
model  parameters  and  even  model  structures  because  of  modeling  errors  from  system  iden¬ 
tifications.  These  uncertainties  may  degrade  the  estimation  performance  of  the  algorithm 
without  robustness.  One  application  area  of  robust  estimation  in  Dr.  Moshfegh’s  project  is 
in  the  automated  landing  of  UCAV  with  passive  sensors. 

In  recent  years,  with  the  advances  of  robust  control  theory,  many  results  on  robust  esti¬ 
mation  have  become  available.  Our  efforts  have  been  directed  towards  deriving  Kalman-type 
estimators  for  linear  time  varying  systems  with  stochastic  uncertainties.  Specifically,  we  have 
derived  an  adaptive  robust  Kalman  filtering  algorithm  that  addresses  estimation  problems 
that  arise  in  linear  time- varying  systems  with  stochastic  parametric  uncertainties.  The  filter 
has  the  one-step  predictor-corrector  structure  and  minimizes  the  mean  square  estimation 
error  at  each  step,  with  the  minimization  reduced  to  a  convex  optimization  problem  based 
on  linear  matrix  inequalities.  The  algorithm  is  shown  to  converge  when  the  system  is  mean 
square  stable  and  the  state-space  matrices  are  time-invariant.  A  numerical  example,  con¬ 
sisting  of  equalizer  design  for  a  communication  channel,  demonstrates  that  our  algorithm 
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offers  considerable  improvement  in  performance  when  compared  to  standard  Kalman  filtering 
techniques. 

The  technical  details  can  be  found  in  [3];  a  preprint  of  this  paper  is  available  on 
the  website 

http : //dynamo . ecn . purdue . edu/~ragu/ onr/ rob-est . html 


1.3  Publications 

Journal  papers  published/accepted  for  publication 

•  A.  L.  Tits  and  V.  Balakrishnan.  “Small-/i  Theorems  with  Frequency-Dependent  Un¬ 
certainty  Bounds”.  Mathematics  of  Control,  Signals,  and  Systems,  vol  11,  no.  3,  pages 
220-243,  1998. 

•  V.  Balakrishnan  and  R.  L.  Kashyap.  “Robust  Stability  and  Performance  Analysis  of 
Uncertain  Systems  Using  Linear  Matrix  Inequalities”.  Journal  of  Optimization  Theory 
and  Applications ,  vol.  100,  no.  3,  March  1999. 

•  A.  L.  Tits,  V.  Balakrishnan  and  L.  Lee.  “Robustness  under  Bounded  Uncertainty  with 
Phase  Information”.  IEEE  Trans.  Aut.  Contr.,  AC-44(l):50-65,  January  1999. 

•  Y.  S.  Chou,  A.  L.  Tits  and  V.  Balakrishnan.  “Absolute  Stability  Theory,  y  Theory, 
and  State-Space  Verification  of  Frequency-Domain  Conditions:  Connections  and  Im¬ 
plications  for  Computation”.  IEEE  Trans.  Aut.  Contr.,  AC-44(5):906-913,  May  1999. 

•  V.  Balakrishnan  and  F.  Wang.  “Efficient  Computation  of  a  Guaranteed  Lower  Bound 
on  the  Robust  Stability  Margin  of  Uncertain  Systems” .  Accepted  for  publication  in 
IEEE  Trans.  Aut.  Contr.,  1999. 

Conference  papers  accepted/published 

•  V.  Balakrishnan  and  F.  Wang.  “Efficient  Computation  of  a  Guaranteed  Lower  Bound 
on  the  Robust  Stability  Margin  of  Uncertain  Systems”.  In  Proc.  IEEE  Conf.  on  Deci¬ 
sion  and  Control,  pages  4406-4407,  Tampa,  FL,  December  1998. 

•  F.  Wang  and  V.  Balakrishnan.  “Improved  Stability  Analysis  and  Gain- Scheduled  Con¬ 
troller  Synthesis  for  Parameter- Dependent  Systems”.  In  Proc.  IEEE  Conf.  on  Decision 
and  Control,  pages  1771-1776,  Tampa,  FL,  December  1998. 

•  F.  Wang  and  V.  Balakrishnan.  “Robust  Adaptive  Kalman  Filters  for  Linear  Time- 
Varying  Systems  with  Stochastic  Parametric  Uncertainties.”  In  IEEE  American  Con¬ 
trol  Conf.,  pages  440-444,  San  Diego,  CA,  June  1999.  Finalist,  best  student  paper 
award. 

•  F.  Wang  and  V.  Balakrishnan.  “Robust  Estimators  for  Systems  with  Both  Deter¬ 
ministic  and  Stochastic  Uncertainties.”  Accepted  for  presentation  in  IEEE  Conf.  on 
Decision  and  Control,  Phoenix,  Arizona,  December  1999. 
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•  F.  Wang  and  V.  Balakrishnan.  “Robustness  analysis  and  gain-scheduled  controller  syn¬ 
thesis  for  rational  parameter-dependent  uncertain  systems  using  parameter-dependent 
Lyapunov  functions.”  Accepted  for  presentation  in  IEEE  Conf.  on  Decision  and  Con¬ 
trol,  Phoenix,  Arizona,  December  1999. 

2  Research  Plan  for  the  next  period 

2.1  Multi-objective  gain-scheduled  controller  synthesis  for  UCAV 
models 

The  simulation  results,  obtained  from  the  Texas  A&M  UCAV  models,  show  considerable 
promise.  Therefore,  further  efforts  will  be  directed  to  study  controller  design  with  other 
performance  measures.  In  particular,  we  intend  to  systematically  study  the  tradeoff  between 
competing  design  requirements. 


2.2  Further  robust  estimation  efforts 

The  preliminary  efforts  towards  robust  estimation  have  concentrated  on  Kalman-type  filter¬ 
ing  problems.  We  intend  to  direct  further  effort  towards  other  robust  estimation  problems, 
such  as  deriving  H^-type  estimators.  We  will  also  direct  our  efforts  towards  applying  some 
of  these  research  results  on  the  specific  problems  that  arise  in  Dr.  Moshfegh’s  project,  such 
as  the  automated  landing  of  UCAV  with  passive  sensors. 
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Gain-scheduled  control  of  the  ONR  UCAV 


Introduction 

The  dynamics  of  Unmanned  Combat  Air  Vehicles  (UCAVs) 
undergoing  aggressive  maneuvers  are  highly  nonlinear  and 
time- varying.  One  approach  towards  modeling  UCAVs  involves 
linearizing  the  dynamics  of  the  UCAV  around  various  points  in  the 
flight  envelope.  Then,  the  composite  model  of  the  UCAV  can  be  given  as  a  linear 
parameter-dependent  model,  with  the  parameters  being  the  flight  conditions.  A 
comprehensive  effort  towards  identifying  such  models  is  currenly  being  undertaken  at  Texas 
A  &  M  University  . 

We  describe  here  research  efforts  towards  a  systematic  design  procedure  for  controller 
synthesis  for  the  linear  parameter-dependent  ONR  UCAV  models.  Traditional  techniques  for 
controller  synthesis  consist  of  designing  a  single  controller  that  is  intended  to  function  across 
varying  flight  conditions.  These  include  constant  state-feedback,  as  well  as  the  celebrated 
LQR/LQG  and  H-inflnity  controllers.  While  these  control  techniques  can  be  sometimes 
proven  to  work  (i.e.,  stabilize  the  system  or  provide  acceptable  performance),  they  can  be 
quite  conservative,  especially  when  the  flight  conditions  vary  considerably. 

Gain-scheduled  controller  design  offers  the  potential  much  more  aggressive  control  design. 
The  basic  idea  is  to  synthesize  a  series  of  dynamic  controllers,  one  for  each  linearized  model 
of  the  UCAV  around  a  flight  condition,  and  then  "schedule"  these  controllers  according  to  the 
actual  flight  condition.  An  ad  hoc  implementation  of  such  a  scheme  is  not  guaranteed  to  work; 
however,  it  is  possible  to  develop  a  gain-scheduling  scheme,  using  Lyapunov  functions,  that 
is  guaranteed  to  work  across  various  flight  regimes. 

Another  advantage  of  an  approach  based  on  Lyapunov  functions  is  that  it  can  be  extended  to 
handle  constraints  other  than  mere  stability.  Stability  requires  the  Lyapunov  function  to 
decrease  along  the  trajectories  of  the  parameter- varying  system.  Additional  constraints  on  the 
Lyapunov  function  can  be  used  to  design  controllers  with  guaranteed  performance.  Examples 
of  performance  measures  are  the  energy  in  the  state  vector,  and  peak  values  of  signals  of 
interest;  in  several  instances,  it  is  desirable  that  these  performance  measures  be  small.  And 
gain-scheduled  controllers  that  minimize  upper  bounds  on  these  performance  measures  can  be 
designed. 

The  technical  details  behind  synthesizing  improved  gain-scheduled  controllers  can  be  found 
in  the  following  papers,  and  the  references  therein: 

-F.  Wang  and  V.  Balakrishnan,  * ' Improved  Stability  Analysis  and  Gain-Scheduled  Controller 
Synthesis  for  Parameter-Dependent  Systems**.  In  Proc.  IEEE  Conf.  on  Decision  and  Control, 
pages  1771-1776,  Tampa,  FL,  December  1998. 

F.  Wang  and  V.  Balakrishnan,  ‘ '  Robustness  analysis  and  gain-scheduled  controller  synthesis 
for  rational  parameter-dependent  uncertain  systems  using  parameter-dependent  Lyapunov 
functions ”.  Accepted  for  presentation  in  the  IEEE  Conf.  on  Decision  and  Control,  December 
1999. 


Gain-scheduled  controllers  for  some  UCAV  models 

We  present  the  application  of  gain-scheduled  controller  design  techniques  on  the  models  for 
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UCAVs  developed  at  Texas  A  &  M  University: 


•  Longitudinal  VSTOL1  model,  stability 

•  Longitudinal  VSTOL1  model,  performance 

•  Lateral/directional  VSTOL1  model,  stability 

•  Lateral/directional  VSTOL1  model,  performance 

•  Longitudinal  UCAV6  model,  stability 

•  Longitudinal  UCAV6  model,  performance 

•  Lateral/directional  UCAV6  model,  stability 

•  Lateral/directional  UCAV6  model,  performance 


MATLAB  code 
MATLAB  code 
MATLAB  code 
MATLAB  code 
MATLAB  code 
MATLAB  code 
MATLAB  code 
MATLAB  code 
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The  research  goals  outlined  in  the  original  proposal  were: 

Deriving  models  for  uncertain  nonlinear  systems  that  lend  themselves  to  the  use  of  robust  control 
techniques. 

Robust  stability  analysis  of  nonlinear  systems  using  optimization  based  on  linear  matrix  inequalities 
(LMIs). 

Robust  performance  analysis  of  nonlinear  systems  using  LMI  methods. 

Gain-scheduled  controller  design. 


The  progress  made  towards  achieving  some  of  these  goals  were  reported  in  two  earlier  reports: 


Progress  report  for  the  period  May  1997  -  October  1997 
Annual  report  for  the  period  1  May  1997  -  30  April  1998 


Progress  since  these  reports  is  described  below: 

Stability  Multipliers  and  p  Upper  Bounds:  Connections  and  Implications  for  Computation 

The  technical  approach  underlying  the  project  uses  convex  optimization  over  Linear  Matrix  Inequalities 
(LMIs)  in  the  framework  on  Integral  Quadratic  Constraints  (IQCs)  to  obtain  sufficient  conditions  for  the 
robust  stability  of  systems  with  structured  uncertainties.  While  this  approach  applies  to  a  wider  class  of 
uncertain  systems  than  those  handled  by  the  traditional  p  methods  of  robust  control,  a  fundamental 
question  is  how  it  compares  with  p  analysis.  We  have  answered  this  question  by  establishing  the 
equivalence  between  the  two  approaches.  In  particular,  the  relationship  between  the  stability  multipliers 
used  in  the  IQC  framework  and  the  scaling  matrices  used  in  the  p  methods  has  been  explicitly 
characterized.  The  development  hinges  on  the  derivation  of  certain  properties  of  a  parameterized  family 
of  complex  LMIs,  a  result  of  independent  interest.  The  derivation  also  suggests  a  general  computational 
framework  for  checking  the  feasibility  of  a  broad  class  of  frequency-dependent  conditions,  based  on 
which  bisection  schemes  can  be  devised  to  reliably  compute  several  quantities  of  interest  for  robust 
control. 

The  results  from  this  work  have  been  reported  in  publication  [1]. 


Small-)!  Theorems  with  Frequency-dependent  Upper  Bounds 

As  noted  before,  the  technical  approach  underlying  the  project  is  equivalent  to  the  traditional  scaling 
methods  of  |x  analysis  when  applied  to  linear  time-invariant  systems  affected  by  structured  linear  time- 
invariant  uncertainties.  The  result  of  such  analyses  are  the  so-called  small-p  theorems,  typically  stated 
when  the  bounds  on  the  uncertainty  norms  are  frequency-independent.  Of  course,  this  is  usually  not  the 
case  in  engineering:  The  uncertainty  sizes  typically  tail  off  at  high  frequencies,  necessitating  the  use  of 
frequency-dependent  norm  bounds.  We  have  derived  conditions,  some  necessary  and  some  sufficient, 
valid  under  weak  assumptions,  for  robust  stability  and  uniform  robust  stability  of  uncertain  linear  time- 
invariant  systems  with  linear  time-invariant  uncertainties  that  are  block-diagonal,  with  known  frequency- 
dependent  norm  bounds  on  the  diagonal  blocks.  Small-p  theorems  with  frequency-independent 
uncertainty  bounds  are  recovered  as  special  cases. 

The  results  from  this  work  have  been  reported  in  publication  [2]. 


Robust  Adaptive  Kalman  Filtering 

Often,  it  is  useful  to  model  uncertain  systems  as  linear  time-varying  systems  with  stochastic  parametric 
uncertainties.  For  such  models,  state  estimation  is  the  first  step  in  designing  control  strategies.  An 
ongoing  effort  is  the  design  of  adaptive  robust  Kalman  filtering  algorithms  that  address  such  estimation 
problems.  Specifically,  we  are  focusing  on  the  design  of  Kalman  filters,  with  the  one-step  predictor- 
corrector  structure,  that  minimize  the  mean  square  estimation  error  at  each  step,  with  the  aim  of 
reformulating  the  minimization  as  a  convex  optimization  problem  based  on  linear  matrix  inequalities. 
Preliminary  results  indicate  that  our  algorithm  offers  considerable  improvement  in  performance  when 
compared  to  standard  Kalman  filtering  techniques. 

The  results  from  this  work  have  been  submitted  for  presentation  at  the  1999  American  Control 
Conference. 
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1  Introduction 


The  models  of  control  systems  encountered  in  several  diverse  naval  applications  are  non¬ 
linear;  moreover,  they  are  also  time-varying,  and  have  uncertainties  affecting  them.  The 
underlying  controller  design  problems,  beyond  requiring  system  stability,  also  typically  re¬ 
quire  the  optimization  of  some  performance  objectives.  Ideally,  the  control  law  should  have 
the  properties  that:  (1)  it  adapts  itself  according  to  the  nonlinearities;  (2)  it  can  handle 
several  performance  objectives  (besides  stability)  in  a  uniform  manner;  and  (3)  it  guarantees 
the  performance  of  the  closed-loop  system  in  spite  of  the  variations  and  the  uncertainties. 

The  goal  of  the  project  is  a  numerical  solution  methodology  for  solving  the  general 
nonlinear  controller  design  problem.  Our  approach  is  motivated  by  recent  advances  in  control 
and  optimization  theory  as  well  as  the  sustained  growth  in  the  available  computing  power 
over  the  past  few  years.  The  proposed  controller  architecture  is  gain-scheduled  (i.e.,  the 
controller  uses  the  measured  nonlinearities  and  time- variations),  and  optimizes  the  worst-case 
performance — over  the  uncertainties — of  the  system.  The  search  for  the  optimal  controller 
parameters  can  be  reformulated  as  convex  optimization  problems  involving  linear  matrix 
inequalities  (LMIs)  in  several  important  cases.  The  design  approach  lends  itself  naturally  to 
the  development  of  computer-aided  design  tools,  and  enjoys  the  advantages  of  widespread 
applicability,  ease  of  implementation  and  cost  effectiveness. 


2  Summary  of  Results  to  Date 

2.1  Robust  stability  and  performance  analysis  using  multiplier 
theory  and  LMI  optimization 

The  first  step  in  realizing  the  project  goals  is  that  of  robustness  analysis  of  nonlinear  sys¬ 
tems.  In  order  to  achieve  this,  we  began  with  a  linear  fractional  representation  of  uncertain 
nonlinear  systems,  shown  in  the  block-diagram  in  Fig.  1. 


Figure  1:  Robustness  analysis  framework. 

In  Fig.  1,  A  consists  of: 

•  uncertainties  affecting  the  system; 

•  non-rational  nonlinearities;  and 

•  appropriate  copies  of  the  state-vector,  so  as  to  realize  any  rational  nonlinearities. 
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With  the  uncertain  nonlinear  system  represented  as  in  Fig.  1,  we  performed  its  robust 
stability  and  performance  analysis  in  a  unified  manner  using  multiplier  theory  [1,  2,  3, 
4,  5],  or  more  generally,  in  the  framework  of  integral  quadratic  constraints  or  IQCs  [6]. 
The  merit  of  this  approach  is  that  several  sufficient  conditions  for  robust  stability  can  be 
performed  without  frequency  sampling,  using  convex  optimization  techniques  based  on  LMIs. 
We  showed  that  multiplier  techniques  yield  a  convex  parametrization  of  a  set  of  Lyapunov 
functions  that  prove  robust  stability.  By  imposing  additional  conditions  on  these  Lyapunov 
functions,  we  derived  bounds  on  the  robust  performance  for  the  system  in  Fig.  1;  thus  we 
used  Lyapunov  functions  to  “prove”  robust  performance.  The  “best”  performance  bounds 
were  obtained  by  numerically  optimizing  these  bounds,  using  LMI-based  methods,  over  the 
set  of  Lyapunov  functions  that  prove  robust  performance. 

The  results  were  documented  in  the  publication  [7]. 

2.2  Robustness  under  bounded  uncertainty  with  phase  informa¬ 
tion 

The  special  case  of  systems  considered  in  Section  2.1  where  there  are  no  nonlinearities, 
and  where  the  uncertainties,  in  addition  to  being  bounded,  also  satisfy  constraints  on  their 
phase,  is  of  particular  interest.  In  this  context,  we  have  defined  the  “phase-sensitive  struc¬ 
tured  singular  value”  (PS-SSV)  of  a  matrix,  and  have  shown  that  sufficient  (and  sometimes 
necessary)  conditions  for  stability  of  such  uncertain  linear  systems  can  be  rewritten  as  con¬ 
ditions  involving  PS-SSV.  We  have  also  derived  upper  bounds  for  PS-SSV,  computable  via 
convex  optimization.  We  have  extended  these  results  to  the  case  where  the  uncertainties  are 
structured  (diagonal  or  block-diagonal,  for  instance). 

The  results  of  this  research  will  appear  in  [8]. 

2.3  Modeling  and  control  of  the  humoral  immune  response 

In  order  to  evaluate  the  efficacy  of  the  approach  described  in  Section  2.1,  we  considered  a 
nonlinear  model  of  the  humoral  immune  response.  The  original  immune  system  model  was  a 
second-order  predator-prey  model  with  a  time-delay  element.  We  obtained  an  approximate 
finite-state  nonlinear  model  next,  with  the  nonlinearities  being  rational  functions  of  the  state 
vector  elements.  This  nonlinear  system  was  then  cast  in  the  robust  control  framework,  by 
using  linear  fractional  transformations;  the  resulting  model  consisted  of  a  fixed  linear  system 
with  multiple  copies  of  the  state  vector  appearing  in  a  feedback  loop.  Optimization  based 
on  LMIs  was  then  applied  to  derive  a  nonlinear  controller  (i.e.,  an  intravenous  drug  delivery 
strategy)  for  this  system  so  as  to  stabilize  the  system,  and  in  addition  to  minimize  a  measure 
of  the  drug  delivered.  Through  simulations,  the  proposed  intravenous  drug  strategy  was 
shown  to  shorten  patient  recovery  time,  to  lower  peak  drug  concentrations  and  to  decrease 
the  total  drug  administered,  when  compared  to  standard  antibiotic  strategies. 

The  results  from  this  work  have  been  reported  in  publication  [9]. 
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2.4  Efficient  computation  of  a  guaranteed  lower  bound  on  the  ro¬ 
bust  stability  margin  of  uncertain  systems 

We  were  also  able  to  substantially  reduce  the  computational  burden  associated  with  LMI 
methods  for  establishing  robust  stability.  Returning  to  the  system  shown  in  Fig.  1,  consider 
the  robust  stability  margin  of  the  system,  defined  as  the  largest  “size”  of  A  against  which 
the  system  is  guaranteed  to  be  stable.  (This  quantity  is  of  considerable  importance  in  robust 
control;  approaches  such  as  y  analysis  [10]  can  be  viewed  as  obtaining  lower  bounds  on  the 
robust  stability  margin.)  When  lower  bounds  on  the  robust  stability  margin  are  obtained 
through  multiplier  methods  using  the  theory  of  Integral  Quadratic  Constraints,  bisection 
schemes  are  typically  used,  with  each  iteration  requiring  the  solution  of  an  LMI  feasibil¬ 
ity  problem.  We  have  been  able  to  avoid  the  bisection  scheme  altogether  by  reformulating 
the  lower  bound  computation  problem  as  a  single  generalized  eigenvalue  minimization  prob¬ 
lem,  which  can  be  solved  very  efficiently  using  standard  algorithms.  We  have  illustrated 
this  with  several  important,  commonly-encountered  special  cases:  Diagonal,  nonlinear  un¬ 
certainties;  diagonal,  memoryless,  time-invariant  sector-bounded  (“Popov”)  uncertainties; 
structured  dynamic  uncertainties;  and  structured  parametric  uncertainties.  We  also  have 
generated  a  numerical  example  that  illustrates  our  approach.  The  following  table  shows 
typical  computational  improvement  that  can  be  expected. 


Uncertainty  Type 

Stab. 

Margin 

Bisect,  (sec) 

Our  scheme  (sec) 

General  nonlinear 

1.2896 

X 

10~2 

5.6800 

0.8200 

Dynamic 

1.2899 

X 

10'2 

62.5700 

20.3000 

Popov-type 

1.3264 

X 

1(T2 

99.5700 

26.5300 

Parametric 

1.3278 

X 

10"2 

51.8400 

19.8300 

The  results  from  this  work  have  been  reported  in  publication  [?]. 

2.5  Improved  stability  analysis  and  gain-scheduled  controller  syn¬ 
thesis  for  parameter-dependent  systems 

We  have  derived  an  algorithm  for  the  robust  stability  analysis  and  gain-scheduled  controller 
synthesis  for  linear  systems  affected  by  time-varying  parametric  uncertainties.  (This  repre¬ 
sents  an  important  first  step  in  our  ultimate  goal  of  deriving  effective  gain-scheduled  control 
strategies  for  nonlinear  systems.)  Sufficient  conditions  for  robust  stability  as  well  as  condi¬ 
tions  for  the  existence  of  a  robustly  stabilizing  gain-scheduled  controller  are  given  in  terms  of 
a  finite  number  of  LMIs;  explicit  formulae  for  constructing  robustly  stabilizing  gain-scheduled 
controllers  are  given  in  terms  of  the  feasible  set  of  these  LMIs.  We  have  proved  that  our 
approach  is  in  general  less  conservative  than  the  existing  methods  for  stability  analysis  and 
gain-scheduled  controller  synthesis  for  parameter- dependent  linear  systems;  numerical  ex¬ 
amples  have  shown  that  our  approach  offers  significant  improvement  in  practice  as  well. 
The  results  from  this  work  have  been  reported  in  publication  [11]. 
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2.6  Algorithms  and  software 

One  of  the  tasks  that  is  of  fundamental  importance  to  the  proposed  project  is  a  survey  of 
optimization  algorithms  and  software  for  the  solution  of  LMI  problems.  A  comprehensive 
overview  of  the  state  of  the  art  of  numerical  algorithms  for  LMI  problems,  and  of  the  available 
software  was  reported  in  publication  [12]. 

2.7  Application  of  results  to  signal  processing  problems 

The  models  underlying  many  signal  processing  systems  are  exactly  the  same  as  those  of 
control  systems.  Motivated  by  this  fact,  we  explored  the  solution  of  some  signal  processing 
problems  using  convex  optimization  using  LMIs,  and  reported  the  results  in  publication  [13]. 


2.8  Publications 

Journal  papers  published/accepted  for  publication 

1.  V.  Balakrishnan  and  R.  L.  Kashyap.  “Robust  Stability  and  Performance  Analysis 
of  Uncertain  Systems  Using  Linear  Matrix  Inequalities”.  To  appear  in  Journal  of 
Optimization  Theory  and  Applications,  vol.  100,  no.  3,  March  1999.  20  pages. 

2.  A.  L.  Tits,  V.  Balakrishnan  and  L.  Lee.  “Robustness  under  Bounded  Uncertainty  with 
Phase  Information”.  To  appear  in  the  IEEE  Trans.  Aut.  Contr.,  1998.  13  pages. 

3.  A.  E.  Rundell,  R.  A.  DeCarlo,  V.  Balakrishnan  and  H.  HogenEsch.  “Investigations 
into  Treatment  Strategies  Aiding  the  Immune  Response  to  Haemophilus  Influenzae” . 
IEEE  Trans.  Biomed.  Eng.,  vol.  45,  no.  4,  pages  429-439,  April  1998. 

4.  V.  Balakrishnan  and  F.  Wang.  “Efficient  Computation  of  a  Guaranteed  Lower  Bound 
on  the  Robust  Stability  Margin  of  Uncertain  Systems”.  To  appear  after  revision  in 
IEEE  Trans.  Aut.  Contr.,  1998. 

5.  L.  Vandenberghe  and  V.  Balakrishnan.  “Algorithms  and  Software  for  LMI  Problems 
in  Control”.  IEEE  Control  Systems  Magazine,  pages  89-95,  October  1997. 

Conference  papers  published 

1.  V.  Balakrishnan  and  L.  Vandenberghe.  “Linear  Matrix  Inequalities  for  signal  pro¬ 
cessing.  An  overview”.  Invited  for  presentation  at  the  32nd  Annual  Conference  on 
Information  Sciences  and  Systems ,  Department  of  Electrical  Engineering,  Princeton 
University,  Princeton  NJ,  March  1998. 

Pending  conference  papers 

1.  V.  Balakrishnan  and  F.  Wang.  “Efficient  Computation  of  a  Guaranteed  Lower  Bound 
on  the  Robust  Stability  Margin  of  Uncertain  Systems”.  Under  review  for  presentation 
at  the  IEEE  Conf.  on  Decision  and  Control,  December  1998. 
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2.  F.  Wang  and  V.  Balakrishnan.  “Improved  Stability  Analysis  and  Gain-Scheduled  Con¬ 
troller  Synthesis  for  Parameter- Dependent  Systems”.  Under  review  for  presentation  at 
the  IEEE  Conf.  on  Decision  and  Control,  December  1998. 

3  Research  Plan  for  the  next  period 

3.1  Gain-scheduled  controller  synthesis  for  nonlinear  systems 

The  research  results  reported  in  Section  2.5  describe  the  synthesis  of  gain-scheduled  con¬ 
trollers  for  linear  systems  affected  by  time- varying  parameters.  The  next  step  is  to  extend 
this  approach  to  the  case  of  nonlinear  parameter-dependent  systems.  The  underlying  tech¬ 
nical  problem  is  to  handle,  in  a  non-conservative  fashion,  multiple  copies  of  the  state  vector 
that  appear  in  A  in  Fig.  1.  One  approach  that  is  promising  is  to  introduce  constant  scaling 
matrices  that  take  advantage  of  the  structure  of  A.  Less  conservative  methods  that  use 
dynamic  scalings  will  also  be  investigated. 

3.2  Tuning  our  approach  towards  the  control  of  Unmanned  Intel¬ 
ligent  Autonomous  Air  Vehicles 

While  our  research  efforts  thus  far  have  tended  to  address  the  fundamentals  of  robust  nonlin¬ 
ear  control,  we  will  next  focus  on  the  specific  problem  of  the  control  of  Unmanned  Intelligent 
Autonomous  Air  Vehicles  (UIAAVs).  To  this  end,  we  will  collaborate  with  other  ONR  re¬ 
searchers  in  this  area.  In  particular,  we  will  test  our  algorithms  on  the  system  models 
gathered  from  other  researchers. 


3.3  Development  of  CAD  tools 

The  proposed  analysis  and  design  techniques  are  applicable  to  other  nonlinear  control  prob¬ 
lems  besides  the  control  of  UIAAVs.  To  enable  such  applications,  CAD  tools  with  graphical 
user  interfaces  can  be  built,  which  will  serve  as  a  valuable  addition  to  the  library  of  per¬ 
formance  evaluation  and  controller  design  software  for  nonlinear  systems.  This  CAD  tool 
will  take  as  (graphical)  input  the  block-diagram  of  the  nonlinear  system,  and  will  generate 
controller  parameters,  and  a  Lyapunov  function  guarantee  for  the  design. 


3.4  Efficient  solution  of  large-scale  linear  matrix  inequalities 

The  linear  matrix  inequalities  encountered  with  our  approach  tend  to  so  large  (both  in  the 
number  of  variables,  as  well  as  the  number  of  constraints)  so  as  to  test  the  limits  of  available 
computing  software.  We  intend  to  explore  alternative  ways  towards  solving  such  large-scale 
LMI  problems  efficiently. 
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The  research  goals  outlined  in  the  original  proposal  were: 

*  Deriving  models  for  uncertain  nonlinear  systems  that  lend 
themselves  to  the  use  of  robust  control  techniques. 

*  Robust  stability  analysis  of  nonlinear  systems  using  optimization 
based  on  linear  matrix  inequalities  (LMIs) . 

*  Robust  performance  analysis  of  nonlinear  systems  using  LMI  methods. 

*  Gain- scheduled  controller  design. 

The  progress  made  towards  achieving  some  of  these  goals  is 
outlined  below: 

ALGORITHMS  AND  SOFTWARE 

One  of  the  tasks  that  is  of  fundamental  importance  to  the 
proposed  project  is  a  survey  of  optimization  algorithms  and 
software  for  the  solution  of  LMI  problems.  This  work  was 
performed  in  collaboration  with  Professor  Vandenberghe  of 
UCLA,  and  a  comprehensive  overview  of  the  state  of  the  art 
of  numerical  algorithms  for  LMI  problems,  and  of  the 
available  software  was  reported  in  publication  [1] . 

ROBUST  STABILITY  AND  PERFORMANCE  ANALYSIS  USING  MULTIPLIER 
THEORY  AND  LMI  OPTIMIZATION 

Our  proposed  approach  for  robust  nonlinear  control  design 
builds  on  the  following:  The  robust  stability  and 
performance  analysis  of  uncertain  systems,  with  various 
assumptions  on  the  nature  of  the  uncertainties 
(sector-bounded  nonlinear,  linear  time-invariant, 
parametric,  etc.),  as  well  as  their  structure  (diagonal, 
block-diagonal,  etc.),  can  be  performed  in  a  unified  manner 
using  multiplier  theory  and  LMI-based  convex  optimization. 

Not  only  does  this  provide  a  unification  of  several 
apparent ly-di^ verse  robust  stability  tests,  but  it  also  paves 
the  way  for  developing  new  stability  tests.  In  addition, 
the  multipliers  used  in  the  stability  analysis  can  be  shown 
to  yield  a  convex  parametrization  of  a  subset  of  Lyapunov 
functions  that  provide  a  certificate  of  robust  stability. 

These  Lyapunov  functions  can  in  turn  be  used  to  derive 
bounds  on  various  robust  performance  measures  for  uncertain 
systems.  A  tutorial  outlining  this  approach  was  prepared 
for  publication  [2] . 

MODELING  AND  CONTROL  OF  THE  HUMORAL  IMMUNE  RESPONSE 
In  order  to  test  of  the  efficacy  of  our  proposed  methods,  a 
nonlinear  model  of  the  humoral  immune  was  considered.  (This 
represents  ongoing  work,  performed  in  collaboration  with 
Professor  DeCarlo  and  Ms.  Rundell  at  the  School  of 
Electrical  and  Computer  Engineering  at  Purdue.)  The 
original  immune  system  model  is  a  second-order  predator-prey 
model  with  a  time-delay  element.  An  approximate 
finite-state  nonlinear  model  was  next  obtained,  with  the 
nonlinearities  being  rational  functions  of  the  state  vector 
elements.  This  nonlinear  system  was  then  cast  in  the  robust 
control  framework,  by  using  linear  fractional 
transformations;  the  resulting  model  consisted  of  a  fixed 
linear  system  with  multiple  copies  of  the  state  vector 
appearing  in  a  feedback  loop.  Optimization  based  on  LMIs 
was  then  applied  to  derive  a  nonlinear  controller  for  this 
system.  The  results  from  this  work  have  been  reported  in 
publication  [3] . 
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